WorkBook status - Waiting for Migration

1 follower
0
Avatar

Dear,

When trying to execute/run a workbook which reads from import job (partitioned),

the workbook just stays in Waiting for Migration status and from log:

[system]  INFO [2016-11-11 07:22:03.752] [JobScheduler thread-1] (NormalJobDriver.java:139) - Checking if DapJobExecution{id=103164, type=NORMAL, status=WAITING} can be started

What is this status and what does it mean?

Other Workbooks are running normally.

Thanks in Advance

 

Best Regards,

Aleksandar Razmovski

 

Aleksandar Razmovski

1 comment

  • Avatar
    Gido

    [Edited/Updated]

    Hi Aleksandar,

    > What is this status and what does it mean?

    Migration: This happens when you change the partitioning of an Import Job. E.g. if an Import Job was not partitioned and you enable partitioning after data has already been imported, the data will be "migrated", i.e. it will be rewritten with the new partition settings. All Workbooks that use the import will have to wait until the migration is completed, because the Workbook assumes the new folder structure, which has to be fully rebuilt. But this only happens when a user changes the Import Job configuration.

    Compaction: This is an optimization that is running in the background. It will not cause Workbooks to wait. The Workbooks will be able to run and use the existing fragmented data until the compacted data becomes available.

    This means: If you are seeing a Workbook in status "Waiting for Migration" this will be because of migration.

    Just let us know if this answer your question. 

    0
Please sign in to leave a comment.