以可视化方式监视 Azure 数据工厂Visually monitor Azure Data Factory

在 Azure 数据工厂中创建并发布管道以后,即可将其与触发器关联,或者手动启动临时运行。Once you've created and published a pipeline in Azure Data Factory, you can associate it with a trigger or manually kick off an ad hoc run. 可以在 Azure 数据工厂用户体验中以本机方式监视所有管道运行。You can monitor all of your pipeline runs natively in the Azure Data Factory user experience. 若要打开监视体验,请在 Azure 门户的数据工厂边栏选项卡中选择“监视和管理”磁贴。 To open the monitoring experience, select the Monitor & Manage tile in the data factory blade of the Azure portal. 如果已在 ADF UX 中,请单击左侧边栏上的“监视”图标。 If you're already in the ADF UX, click on the Monitor icon on the left sidebar.

所有数据工厂运行都以浏览器的本地时区显示。All data factory runs are displayed in the browser's local time zone. 如果更改时区,所有日期/时间字段都将调整为所选的时区。If you change the time zone, all the date/time fields snap to the one that you selected.

监视管道运行Monitor pipeline runs

默认监视视图是所选时段内管道运行的列表。The default monitoring view is list of pipeline runs in the selected time period. 以下列会显示:The following columns are displayed:

列名Column name 说明Description
管道名称Pipeline Name 管道的名称Name of the pipeline
操作Actions 图标,用于查看活动详细信息、取消或重新运行管道Icons that allow you to view activity details, cancel, or rerun the pipeline
运行开始时间Run Start 管道运行的开始日期和时间(MM/DD/YYYY,HH:MM:SS AM/PM)Start date and time for the pipeline run (MM/DD/YYYY, HH:MM:SS AM/PM)
持续时间Duration 运行持续时间 (HH:MM:SS)Run duration (HH:MM:SS)
触发者Triggered By 启动了管道的触发器的名称The name of the trigger that started the pipeline
状态Status 失败成功正在进行已取消已排队Failed, Succeeded, In Progress, Canceled, or Queued
批注Annotations 与管道关联的可筛选标记Filterable tags associated with a pipeline
parametersParameters 管道运行的参数(名称/值对)Parameters for the pipeline run (name/value pairs)
错误Error 在管道失败的情况下出现的运行错误If the pipeline failed, the run error
运行 IDRun ID 管道运行的 IDID of the pipeline run

用于监视管道运行的列表视图

需要手动选择“刷新”按钮来刷新管道和活动运行的列表。 You need to manually select the Refresh button to refresh the list of pipeline and activity runs. 当前不支持自动刷新。Autorefresh is currently not supported.

“刷新”按钮

监视活动运行Monitor activity runs

若要查看每个管道运行的活动运行,请在“操作”列下选择“查看活动运行”图标。 To view activity runs for each pipeline run, select the View activity runs icon under the Actions column. 列表视图显示对应于每个管道运行的活动运行。The list view shows activity runs that correspond to each pipeline run.

列名Column name 说明Description
活动名称Activity Name 管道中的活动的名称Name of the activity inside the pipeline
活动类型Activity Type 活动类型,例如“复制”、“HDInsightSpark”或“HDInsightHive”。 Type of the activity, such as Copy, HDInsightSpark, or HDInsightHive
操作Actions 图标,用于查看 JSON 输入信息、JSON 输出信息或详细的特定于活动的监视体验Icons that allow you to see JSON input information, JSON output information, or detailed activity-specific monitoring experiences
运行开始时间Run Start 活动运行的开始日期和时间(MM/DD/YYYY,HH:MM:SS AM/PM)Start date and time for the activity run (MM/DD/YYYY, HH:MM:SS AM/PM)
持续时间Duration 运行持续时间 (HH:MM:SS)Run duration (HH:MM:SS)
状态Status 失败成功正在进行已取消Failed, Succeeded, In Progress, or Canceled
Integration RuntimeIntegration Runtime 运行活动时所在的 Integration RuntimeWhich Integration Runtime the activity was run on
用户属性User Properties 活动的用户定义属性User-defined properties of the activity
错误Error 在活动失败的情况下出现的运行错误If the activity failed, the run error
运行 IDRun ID 活动运行的 IDID of the activity run

用于监视活动运行的列表视图

提升要监视的用户属性Promote user properties to monitor

将任何管道活动属性提升为用户属性,使其成为受监视的实体。Promote any pipeline activity property as a user property so that it becomes an entity that you monitor. 例如,可以将管道中复制活动的目标属性提升为用户属性。For example, you can promote the Source and Destination properties of the copy activity in your pipeline as user properties. 选择“自动生成” ,为复制活动生成“源” 和“目标” 用户属性。Select Auto Generate to generate the Source and Destination user properties for a copy activity.

创建用户属性

Note

最多只能将五个管道活动属性提升为用户属性。You can only promote up to five pipeline activity properties as user properties.

创建用户属性后,便可在监视列表视图中监视它们。After you create the user properties, you can monitor them in the monitoring list views. 如果复制活动的源是表名,则可以将源表名称作为活动运行列表视图中的列进行监视。If the source for the copy activity is a table name, you can monitor the source table name as a column in the list view for activity runs.

没有用户属性的活动运行列表

将用户属性的列添加到活动运行列表

具有用户属性的列的活动运行列表

配置列表视图Configure the list view

排序和筛选Order and filter

进行切换操作,以便根据运行开始时间按降序或升序来排列管道运行。Toggle whether pipeline runs will be in descending or ascending according to the run start time. 使用以下列来筛选管道运行:Filter pipeline runs by using the following columns:

列名Column name 说明Description
管道名称Pipeline Name 按管道名称筛选。Filter by the name of the pipeline.
运行开始时间Run Start 确定所显示的管道运行的时间范围。Determine the time range of the pipeline runs displayed. 选项包括针对“过去 24 小时”、“过去一周”、“过去 30 天”的快速筛选器,还可以选择一个自定义日期和时间。 Options include quick filters for Last 24 hours, Last week, and Last 30 days or to select a custom date and time.
运行状态Run Status 按状态筛选运行:成功失败已排队已取消正在进行Filter runs by status: Succeeded, Failed, Queued, Canceled, or In Progress.
批注Annotations 按应用到每个管道的标记进行筛选Filter by tags applied to each pipeline
运行次数Runs 筛选是否要查看重新运行的管道Filter whether you want to see reran pipelines

筛选选项

添加或删除列Add or remove columns

右键单击列表视图标题,并选择希望在列表视图中显示的列。Right-click the list view header and choose columns that you want to appear in the list view.

列选项

调整列宽Adjust column widths

通过将鼠标指针悬停在列标题上来增大或减小列表视图中的列宽。Increase and decrease the column widths in the list view by hovering over the column header.

重新运行管道中的活动Rerun activities inside a pipeline

可以重新运行管道中的活动。You can rerun activities inside a pipeline. 选择“查看活动运行” 并选择要从管道中的活动中的哪个点重新运行管道。Select View activity runs, and then select the activity in your pipeline from which point you want to rerun your pipeline.

查看活动运行

选择一个活动运行

查看重新运行历史记录View rerun history

可以查看列表视图中所有管道运行的重新运行历史记录。You can view the rerun history for all the pipeline runs in the list view.

查看历史记录

还可以查看特定管道运行的重新运行历史记录。You can also view rerun history for a particular pipeline run.

查看管道运行的历史记录

甘特图Gantt views

使用甘特图可以快速可视化管道和活动运行。Use Gantt views to quickly visualize your pipelines and activity runs.

甘特图示例

可以根据在管道上创建的注释/标记,按管道或组查看甘特图。You can look at the Gantt view per pipeline or group by annotations/tags that you've created on your pipelines.

甘特图注释

条形长度表示管道持续时间。The length of the bar informs the duration of the pipeline. 还可以选择条形来查看更多详细信息。You can also select the bar to see more details.

甘特图持续时间

引导式演示Guided tours

选择左下角的“信息”图标。 Select the Information icon on the lower left. 然后选择“引导式演示”来获取有关如何监视管道和活动运行的分步说明。 Then select Guided Tours to get step-by-step instructions on how to monitor your pipeline and activity runs.

引导式演示

警报Alerts

可在数据工厂中发出有关受支持指标的警报。You can raise alerts on supported metrics in Data Factory. 在数据工厂监视页上选择“监视” > “警报和指标”即可开始。 Select Monitor > Alerts & Metrics on the Data Factory monitoring page to get started.

数据工厂监视页

有关此功能的 7 分钟介绍和演示,请观看以下视频:For a seven-minute introduction and demonstration of this feature, watch the following video:

创建警报Create alerts

  1. 选择“新建警报规则”,创建新的警报 。Select New Alert Rule to create a new alert.

    “新建警报规则”按钮

  2. 指定规则名称,然后选择警报严重性。Specify the rule name and select the alert severity.

    规则名称和严重性的框

  3. 选择警报条件。Select the alert criteria.

    目标条件的框

    条件列表

  4. 配置警报逻辑。Configure the alert logic. 可以针对所选的指标为所有管道和对应的活动创建警报。You can create an alert for the selected metric for all pipelines and corresponding activities. 还可以选择特定的活动类型、活动名称、管道名称或故障类型。You can also select a particular activity type, activity name, pipeline name, or failure type.

    用于配置警报逻辑的选项

  5. 为警报配置电子邮件、短信。Configure email, SMS for the alert. 为警报通知创建一个操作组,或选择现有的操作组。Create an action group, or choose an existing one, for the alert notifications.

    用于配置通知的选项

    用于添加通知的选项

  6. 创建警报规则。Create the alert rule.

    用于创建警报规则的选项

后续步骤Next steps

若要了解有关监视和管理管道的信息,请参阅以编程方式监视和管理管道一文。To learn about monitoring and managing pipelines, see the Monitor and manage pipelines programmatically article.