Jobs in a project

A job is a way of running analytical assets, such as Data Refinery flows, SPSS Modeler flows, or notebooks in a project in Watson Studio.

You can create jobs for the following assets:

  • Data Refinery flows
  • SPSS Modeler flows
  • Jupyter notebooks
  • Metadata import assets

You can create a job in one of several ways:

From the Jobs tab of your project, you can:

  • See the list of the jobs in your project.
  • View the details of each job, including editing settings. You can also start a job manually from here. See Viewing jobs in a project.
  • Monitor job runs
  • Delete jobs

Creating jobs in Data Refinery

You can create a job to run a Data Refinery flow directly in Data Refinery.

  1. In Data Refinery, click the Jobs icon  the jobs icon from the Data Refinery toolbar and select Save and create a job.
  2. Define the job details by entering a name and a description (optional).
  3. On the Configure page, you can:

    • View which input data file is used and what the output file will be called.
    • Select an environment runtime for the job.
  4. On the Schedule page:

    • Optional: Add a one-time or repeating schedule. Ensure that you define meaningful date and time ranges. You can’t change the time zone; the schedule uses your web browser’s time zone setting. You can select to exclude days in schedules running by minutes, hours, and days. Excluding days is not available for schedules that run by the week, where you must select a specific day in the week, and by the month, where again you must select a day in the month.

    Note that if you exclude certain week days, the job might not run as you would expect. The reason might be due to a discrepancy between the time zone of the user who creates the schedule, and the time zone of the compute node where the job runs.

  5. Review the job settings. Then create the job and run it immediately, or create the job and run it later.

You can track the status of a job’s run and view the logs on the job’s run description page. See Viewing jobs in a project.

Creating jobs in SPSS Modeler

You can create a job to run an SPSS Modeler flow directly in SPSS Modeler.

  1. In SPSS Modeler, click the Jobs icon  the jobs icon from the SPSS Modeler toolbar and select Create a job.
  2. Define the job details by entering a name, a description (optional), and specifying job parameters if you have any set up in the flow’s properties.
  3. If you want to schedule the job to run, click the Schedule off toggle switch to turn on scheduling:

    • Optional: Add a one-time or repeating schedule. Ensure that you define meaningful date and time ranges. You can’t change the time zone; the schedule uses your web browser’s time zone setting. You can select to exclude days in schedules running by minutes, hours, and days. Excluding days is not available for schedules that run by the week, where you must select a specific day in the week, and by the month, where again you must select a day in the month.

    Note that if you exclude certain week days, the job might not run as you would expect. The reason might be due to a discrepancy between the time zone of the user who creates the schedule, and the time zone of the compute node where the job runs.

  4. Review the job settings. Then create the job and run it immediately, or create the job and run it later.

You can track the status of a job’s run and view the logs on the job’s run description page. See Viewing jobs in a project.

Creating jobs in the notebook editor or viewer

You can create a job to run a notebook directly from the notebook editor or the notebook viewer by clicking the Jobs icon the jobs icon from the notebook’s menu bar. See Create a notebook job.

Creating a metadata import job

A metadata import job is created at the time you create a metadata import asset. See Creating a metadata import asset and importing metadata.

Creating jobs from the Assets page

You can create jobs for Data Refinery flows, SPSS Modeler flows, Jupyter notebooks from the Assets page of a project.

  1. Select the asset from the section for your asset type and choose Create job from the ACTIONS menu.
  2. Define the job details by entering a name and a description (optional).
  3. On the Configure page, select an environment runtime for the job. Depending on the asset, you can optionally configure additional settings, for example environment variables or script arguments.
  4. On the Schedule page, you can optionally add a one-time or repeating schedule.
  5. Review the job settings. Then create the job and run it immediately, or create the job and run it later.

Viewing jobs associated with an asset

If other jobs exist that are associated with your asset, you can view these without running the job.

  1. Click the Jobs icon the jobs icon from the toolbar in Data Refinery, SPSS Modeler, or in the notebook editor or viewer, and then select Save and view jobs. This lists the jobs that exist for the asset.
  2. Click View to see the details of a selected job.

Alternatively, you can view the details of the jobs associated with your asset by clicking the jobs from the Jobs tab of your project.

Viewing jobs in a project

You can view all of the jobs that exist for your project from the project’s Jobs page. You must have Admin or Editor rights to view job details and carry out actions. With Viewer rights for the project, you can only view details.

To view the details of a specific job, click the job. From the job’s details page, you can:

  • View the runs for that job and the status of each run. If a run failed, you can select the run and view the log tail or download the entire log file to help you troubleshoot the run. A failed run might be related to a temporary connection or environment problem. Try running the job again. If the job still fails, you can send the log to Customer Support.
  • Edit job settings like the schedule settings or pick another environment definition.
  • Run the job manually by clicking the run icon from the jobs action bar. You must deselect the schedule to run the job manually.
  • Delete a job.