How to auto-update a sheet when a job finishes with the single result entry?

2 followers
0
Avatar

Use case: my workbook is scheduled to run weekly.Upon completion, it will generate one single number. I want to have a sheet that gets automatically updated when that number arrives, as long with the date of arrival.

Currently, I have it in a sheet, but the next time the workbook is run, the number will be updated with a new one.

Simon Gao

Official comment

  • Avatar
    Joel Stewart

    Simon, I don't think that I understand the use case that you've described fully. 

    That being the case, I may be missing some details that may prevent this as a solution. It sounds like you want to utilize a Data Driven Trigger for the workbook which is described here in our documentation: Configuring Workbook Settings - Triggers

    If that does not work for this use case, could you please elaborate a bit more on the use case? 

    0

5 comments

  • Avatar
    Simon Gao

    Thanks Joel. I checked the Triggers doc, but I don't think it has what I'm looking for, so let me elaborate on the use case a bit more.

    I have a workbook that produces one number upon completion. It's stored in a sheet (that sheet only has that number and nothing else). I have this workbook scheduled to run weekly, so I would get a new number every week. I want to be able to look at how this number changes across time, in other words, I want to have a scatter plot on the result of the workbook. Having X-axis be the start-of-the-week date, and Y-axis be the number.

    So the question is, how do I achieve this? 

    0
  • Avatar
    Joel Stewart

    Thanks for clarifying Simon, that makes more sense and yes triggers are not relevant here. 

    To preserve the results from an historical run of the workbook, we recommend exporting this data to another location (i.e. on HDFS). Specifically, you could export the value and the date of the job's execution whenever the workbook completes. Future exports can append new values to the exported data set so that you can maintain the full history of all values. 

    0
  • Avatar
    Simon Gao

    Thanks Joel. 

    Is exporting to HDFS something that has to be done manually or automatically? Is there a documentation on this feature? 

    0
  • Avatar
    Joel Stewart

    The documentation is available here: Exporting Data

    The Export Job configuration can be configured to run as soon as the workbook completes. With that configuration, the export is automatic. But it could also be configured on a calendar schedule or executed manually. 

    0
Please sign in to leave a comment.