以可视化方式监视 Azure 数据工厂Visually monitor Azure Data Factory

适用于: Azure 数据工厂 Azure Synapse Analytics

在 Azure 数据工厂中创建并发布管道以后,即可将其与触发器关联,或者手动启动临时运行。Once you've created and published a pipeline in Azure Data Factory, you can associate it with a trigger or manually kick off an ad hoc run. 可以在 Azure 数据工厂用户体验中以本机方式监视所有管道运行。You can monitor all of your pipeline runs natively in the Azure Data Factory user experience. 若要打开监视体验,请在 Azure 门户的数据工厂边栏选项卡中选择“监视和管理”磁贴。To open the monitoring experience, select the Monitor & Manage tile in the data factory blade of the Azure portal. 如果已在 ADF UX 中,请单击左侧边栏上的“监视”图标。If you're already in the ADF UX, click on the Monitor icon on the left sidebar.

默认情况下,所有数据工厂运行都以浏览器的本地时区显示。By default, all data factory runs are displayed in the browser's local time zone. 如果你更改时区,所有日期/时间字段都会与你选择的时区保持一致。If you change the time zone, all the date/time fields snap to the one that you selected.

监视管道运行Monitor pipeline runs

默认监视视图是所选时段内触发的管道运行的列表。The default monitoring view is list of triggered pipeline runs in the selected time period. 你可以更改时间范围并按状态、管道名称或注释进行筛选。You can change the time range and filter by status, pipeline name, or annotation. 将鼠标悬停在特定管道运行上可获取特定于运行的操作,如重新运行和消耗报告。Hover over the specific pipeline run to get run-specific actions such as rerun and the consumption report.

用于监视管道运行的列表视图

管道运行网格包含以下列:The pipeline run grid contains the following columns:

列名Column name 说明Description
管道名称Pipeline Name 管道的名称Name of the pipeline
运行开始时间Run Start 管道运行的开始日期和时间(MM/DD/YYYY,HH:MM:SS AM/PM)Start date and time for the pipeline run (MM/DD/YYYY, HH:MM:SS AM/PM)
运行结束时间Run End 管道运行的结束日期和时间(MM/DD/YYYY,HH:MM:SS AM/PM)End date and time for the pipeline run (MM/DD/YYYY, HH:MM:SS AM/PM)
持续时间Duration 运行持续时间 (HH:MM:SS)Run duration (HH:MM:SS)
触发者Triggered By 启动了管道的触发器的名称The name of the trigger that started the pipeline
状态Status 失败成功正在进行已取消已排队Failed, Succeeded, In Progress, Canceled, or Queued
批注Annotations 与管道关联的可筛选标记Filterable tags associated with a pipeline
参数Parameters 管道运行的参数(名称/值对)Parameters for the pipeline run (name/value pairs)
错误Error 在管道失败的情况下出现的运行错误If the pipeline failed, the run error
运行 IDRun ID 管道运行的 IDID of the pipeline run

需要手动选择“刷新”按钮来刷新管道和活动运行的列表。You need to manually select the Refresh button to refresh the list of pipeline and activity runs. 当前不支持自动刷新。Autorefresh is currently not supported.

“刷新”按钮

若要查看调试运行的结果,请选择“调试”选项卡。To view the results of a debug run, select the Debug tab.

选择查看活动调试运行图标

监视活动运行Monitor activity runs

若要获取某特定管道运行的单个活动运行的详细视图,请单击管道名称。To get a detailed view of the individual activity runs of a specific pipeline run, click on the pipeline name.

查看活动运行

此列表视图显示了与每个管道运行对应的活动运行。The list view shows activity runs that correspond to each pipeline run. 将鼠标悬停在该特定活动运行上可获取特定于运行的信息,如 JSON 输入、JSON 输出和详细的特定于活动的监视体验。Hover over the specific activity run to get run-specific information such as the JSON input, JSON output, and detailed activity-specific monitoring experiences.

存在有关 SalesAnalyticsMLPipeline 的信息,后跟活动运行的列表。

列名Column name 说明Description
活动名称Activity Name 管道中的活动的名称Name of the activity inside the pipeline
活动类型Activity Type 活动类型,例如“复制”、“HDInsightSpark”或“HDInsightHive”。Type of the activity, such as Copy, HDInsightSpark, or HDInsightHive
操作Actions 图标,用于查看 JSON 输入信息、JSON 输出信息或详细的特定于活动的监视体验Icons that allow you to see JSON input information, JSON output information, or detailed activity-specific monitoring experiences
运行开始时间Run Start 活动运行的开始日期和时间(MM/DD/YYYY,HH:MM:SS AM/PM)Start date and time for the activity run (MM/DD/YYYY, HH:MM:SS AM/PM)
持续时间Duration 运行持续时间 (HH:MM:SS)Run duration (HH:MM:SS)
状态Status 失败成功正在进行已取消Failed, Succeeded, In Progress, or Canceled
Integration RuntimeIntegration Runtime 运行活动时所在的 Integration RuntimeWhich Integration Runtime the activity was run on
用户属性User Properties 活动的用户定义属性User-defined properties of the activity
错误Error 在活动失败的情况下出现的运行错误If the activity failed, the run error
运行 IDRun ID 活动运行的 IDID of the activity run

如果某个活动失败,可通过单击错误列中的图标来查看详细的错误消息。If an activity failed, you can see the detailed error message by clicking on the icon in the error column.

将出现一条包含错误详细信息的通知,其中包括错误代码、失败类型和错误详细信息。

提升要监视的用户属性Promote user properties to monitor

将任何管道活动属性提升为用户属性,使其成为受监视的实体。Promote any pipeline activity property as a user property so that it becomes an entity that you monitor. 例如,可以将管道中复制活动的“源”和“目标”属性提升为用户属性。For example, you can promote the Source and Destination properties of the copy activity in your pipeline as user properties.

备注

最多只能将五个管道活动属性提升为用户属性。You can only promote up to five pipeline activity properties as user properties.

创建用户属性

创建用户属性后,便可在监视列表视图中监视它们。After you create the user properties, you can monitor them in the monitoring list views.

将用户属性的列添加到活动运行列表

如果复制活动的源是表名,则可以将源表名称作为活动运行列表视图中的列进行监视。If the source for the copy activity is a table name, you can monitor the source table name as a column in the list view for activity runs.

具有用户属性的列的活动运行列表

重新运行管道和活动Rerun pipelines and activities

若要从开始处重新运行之前已运行过的管道,请将鼠标悬停在该特定管道运行上,并选择“重新运行”。To rerun a pipeline that has previously ran from the start, hover over the specific pipeline run and select Rerun. 如果选择多个管道,可以使用“重新运行”按钮来运行所有这些管道。If you select multiple pipelines, you can use the Rerun button to run them all.

重新运行管道

如果需要从某个特定点开始重新运行,可从活动运行视图中执行此操作。If you wish to rerun starting at a specific point, you can do so from the activity runs view. 选择需要作为开始位置的活动,并选择“从活动重新运行”。Select the activity you wish to start from and select Rerun from activity.

重新运行活动运行

从失败的活动重新运行Rerun from failed activity

如果某个活动失败、超时或被取消,则可以通过选择“从失败的活动重新运行”来从该失败的活动重新运行管道。If an activity fails, times out, or is canceled, you can rerun the pipeline from that failed activity by selecting Rerun from failed activity.

重新运行失败的活动

查看重新运行历史记录View rerun history

可以查看列表视图中所有管道运行的重新运行历史记录。You can view the rerun history for all the pipeline runs in the list view.

查看历史记录

还可以查看特定管道运行的重新运行历史记录。You can also view rerun history for a particular pipeline run.

查看管道运行的历史记录

监视消耗Monitor consumption

通过单击管道运行旁边的消耗图标,可以查看运行消耗的资源。You can see the resources consumed by a pipeline run by clicking the consumption icon next to the run.

屏幕截图显示了可查看管道所用资源的位置。

单击此图标会打开相应管道运行所使用的资源的消耗报告。Clicking the icon opens a consumption report of resources used by that pipeline run.

监视消耗

可以将这些值插入到 Azure 定价计算器中,以估计管道运行的成本。You can plug these values into the Azure pricing calculator to estimate the cost of the pipeline run. 若要详细了解 Azure 数据工厂定价,请参阅了解定价For more information on Azure Data Factory pricing, see Understanding pricing.

备注

定价计算器返回的这些值是估计值。These values returned by the pricing calculator is an estimate. 它并不反映 Azure 数据工厂将向你收取的确切金额It doesn't reflect the exact amount you will be billed by Azure Data Factory

甘特视图Gantt views

甘特图是一种可用于查看某个时间范围内的运行历史记录的视图。A Gantt chart is a view that allows you to see the run history over a time range. 切换到甘特视图后,将会看到所有管道运行都按名称分组,并显示为与运行所用时间长度相关的条形。By switching to a Gantt view, you will see all pipeline runs grouped by name displayed as bars relative to how long the run took. 还可以按已在管道上创建的注释/标记进行分组。You can also group by annotations/tags that you've create on your pipeline. 在活动运行级别也可使用甘特视图。The Gantt view is also available at the activity run level.

甘特图示例

条形长度表示管道持续时间。The length of the bar informs the duration of the pipeline. 还可以选择条形来查看更多详细信息。You can also select the bar to see more details.

甘特图持续时间

警报Alerts

可在数据工厂中发出有关受支持指标的警报。You can raise alerts on supported metrics in Data Factory. 在“数据工厂监视”页上,依次选择“监视” > “警报和指标”,以开始操作。Select Monitor > Alerts & metrics on the Data Factory monitoring page to get started.

数据工厂监视页

创建警报Create alerts

  1. 选择“新建警报规则”,以新建警报。Select New alert rule to create a new alert.

    “新建警报规则”按钮

  2. 指定规则名称,然后选择警报严重性。Specify the rule name and select the alert severity.

    规则名称和严重性的框

  3. 选择警报条件。Select the alert criteria.

    目标条件的框

    屏幕截图显示了选择一个指标来设置警报条件的位置。

    条件列表

    可以针对各种指标创建警报,包括 ADF 实体计数/大小、活动/管道/触发器运行、Integration Runtime (IR) CPU 利用率/内存/节点计数/队列,以及 SSIS 包执行和 SSIS IR 启动/停止操作的指标。You can create alerts on various metrics, including those for ADF entity count/size, activity/pipeline/trigger runs, Integration Runtime (IR) CPU utilization/memory/node count/queue, as well as for SSIS package executions and SSIS IR start/stop operations.

  4. 配置警报逻辑。Configure the alert logic. 可以针对所选的指标为所有管道和对应的活动创建警报。You can create an alert for the selected metric for all pipelines and corresponding activities. 还可以选择特定的活动类型、活动名称、管道名称或故障类型。You can also select a particular activity type, activity name, pipeline name, or failure type.

    用于配置警报逻辑的选项

  5. 为警报配置电子邮件、短信、推送和语音通知。Configure email, SMS, push, and voice notifications for the alert. 为警报通知创建一个操作组,或选择现有的操作组。Create an action group, or choose an existing one, for the alert notifications.

    用于配置通知的选项

    用于添加通知的选项

  6. 创建警报规则。Create the alert rule.

    用于创建警报规则的选项

后续步骤Next steps

若要了解有关监视和管理管道的信息,请参阅以编程方式监视和管理管道一文。To learn about monitoring and managing pipelines, see the Monitor and manage pipelines programmatically article.