0 / 0
Managing scheduling of enrichment jobs
Last updated: Dec 05, 2024
Managing scheduling of enrichment jobs

To balance the workload, you can configure job execution windows for metadata enrichment jobs in each project. Runs of basic metadata enrichment jobs are then restricted to specific time ranges on selected days of the week.

Required permissions
To set up and manage job execution windows, you must have the Admin role in the project. Any project collaborator can view the settings.

By default, metadata enrichment jobs run as configured in the metadata enrichment asset. They can run on demand, immediately after you create a metadata enrichment, or on the specified schedule. Depending on the scope of data to be enriched and the selected enrichment options, metadata enrichment can be resource-intensive and take a long time to complete. Therefore, you might want metadata enrichment jobs to run only when the general processing load is low, such as after regular office hours or on weekends. By setting up job execution windows, you can control when metadata enrichment jobs are run.

With job execution windows, metadata enrichment jobs run as follows:

  • Manually triggered job runs

    If a run is started within any of the configured windows, the job runs as requested. Otherwise, the job run starts but is paused immediately and resumes when the next job execution window opens.

  • Job runs directly after creation of a metadata enrichment asset

    If the asset is created within the time frame of a job execution window, the job runs as expected. Otherwise, the job run starts but is paused immediately and resumes when the next job execution window opens.

  • Scheduled job runs

    If the schedule aligns with the configured job execution windows, the job runs as scheduled. Otherwise, the job run starts as scheduled but is paused immediately and resumes when the next job execution window opens.

If the job is still running when job execution window closes, the job run is paused until the next job execution window opens.

To configure job execution windows:

  1. Go to the Manage page in the project and select Tools > Job execution windows.
  2. Select the days on which you want metadata enrichment jobs to run.
  3. For each selected day, set a start and end time. You can specify a time range that crosses midnight so that the window extends to the next day. In this case, you don't have to select the corresponding day explicitly.

Job execution windows apply to all metadata enrichment jobs in a project. Changes to the window configuration are applied to new metadata enrichments and to enrichment jobs that run after the configuration changed.

You can update job execution windows as required. The changes are applied to jobs that are created after you updated the window configuration or to new runs of existing jobs. However, if you remove all job execution windows, you must manually resume any job run that was paused because of configured job execution windows.

Learn more

Parent topic: Managing enrichment jobs

Generative AI search and answer
These answers are generated by a large language model in watsonx.ai based on content from the product documentation. Learn more