Create and manage scheduled notebook jobs

  • Article

You can create and manage notebook jobs directly in the notebook UI. If a notebook is already assigned to one or more jobs, you can create and manage schedules for those jobs. If a notebook is not assigned to a job, you can create a job and a schedule to run the notebook.

Schedule a notebook job

To schedule a notebook job to run periodically:

  1. In the notebook, click Notebook schedule button at the top right. If no jobs exist for this notebook, the Schedule dialog appears.

    Schedule notebook dialog

    If jobs already exist for the notebook, the Jobs List dialog appears. To display the Schedule dialog, click Add a schedule.

    Job list dialog

  2. In the Schedule dialog, optionally enter a name for the job. The default name is the name of the notebook.

  3. Select Manual to run your job only when manually triggered, or Scheduled to define a schedule for running the job. If you select Scheduled, use the drop-downs to specify the frequency, time, and time zone.

  4. In the Compute drop-down, select the compute resource to run the task.

    If the notebook is attached to a SQL warehouse, the default compute is the same SQL warehouse.

    If you have Allow Cluster Creation permissions, the job runs on a new job cluster by default. To edit the configuration of the default job cluster, click Edit at the right of the field to display the cluster configuration dialog. If you do not have Allow Cluster Creation permissions, the job runs on the cluster that the notebook is attached to by default. If the notebook is not attached to a cluster, you must select a cluster from the Cluster dropdown.

  5. Optionally, enter any Parameters to pass to the job. Click Add and specify the key and value of each parameter. Parameters set the value of the notebook widget specified by the key of the parameter. Use dynamic value references to pass a limited set of dynamic values as part of a parameter value.

  6. Optionally, specify email addresses to receive Alerts on job events. See Add email and system notifications for job events.

  7. Click Submit.

Run a notebook job

To manually run a notebook job:

  1. In the notebook, click Notebook schedule button at the top right.
  2. Click Run now.
  3. To view the job run details, click New Tab Icon.

Manage scheduled notebook jobs

To display jobs associated with this notebook, click the Schedule button. The jobs list dialog appears, showing all jobs currently defined for this notebook. To manage jobs, click Kebab menu at the right of a job in the list.

Job list menu

From this menu, you can edit the schedule, clone the job, view job run details, pause the job, resume the job, or delete a scheduled job.

When you clone a scheduled job, a new job is created with the same parameters as the original. The new job appears in the list with the name Clone of <initial job name>.

How you edit a job depends on the complexity of the job's schedule. Either the Schedule dialog or the job details panel displays, allowing you to edit the schedule, cluster, parameters, and so on. See Trigger types for Databricks Jobs.