作业因作业速率限制而失败Job fails due to job rate limit

问题Problem

Azure Databricks 笔记本或作业 API 请求返回以下错误:An Azure Databricks notebook or Jobs API request returns the following error:

Error : {"error_code":"INVALID_STATE","message":"There were already 1000 jobs created in past 3600 seconds, exceeding rate limit: 1000 job creations per 3600 seconds."}

原因Cause

发生此错误的原因如下:每小时的作业数超过了 Azure Databricks 为防止 API 滥用并确保服务质量而设定的上限 1000。This error occurs because the number of jobs per hour exceeds the limit of 1000 established by Azure Databricks to prevent API abuses and ensure quality of service.

解决方案Solution

如果无法确保工作区中每小时创建的作业数少于 1000,请联系 Azure Databricks 支持人员,请求提高上限。If you cannot ensure that the number of jobs created in your workspace is less than 1000 per hour, contact Azure Databricks Support to request a higher limit. 提高作业速率限制需至少停机 20 分钟。A job rate limit increase requires at least 20 minutes of downtime.

  • Azure Databricks 可将作业限制 maximumJobCreationRate 提高到 2000。Azure Databricks can increase the job limit maximumJobCreationRate up to 2000.
  • 提高上限时,当前正在运行的作业将受到影响。Currently running jobs will be affected while the limit is being increased.