以可视化方式监视 Azure 数据工厂Visually monitor Azure Data Factory
Azure 数据工厂
Azure Synapse Analytics
在 Azure 数据工厂中创建并发布管道以后,即可将其与触发器关联,或者手动启动临时运行。Once you've created and published a pipeline in Azure Data Factory, you can associate it with a trigger or manually kick off an ad hoc run. 可以在 Azure 数据工厂用户体验中以本机方式监视所有管道运行。You can monitor all of your pipeline runs natively in the Azure Data Factory user experience. 若要打开监视体验,请在 Azure 门户的数据工厂边栏选项卡中选择“监视和管理”磁贴。To open the monitoring experience, select the Monitor & Manage tile in the data factory blade of the Azure portal. 如果已在 ADF UX 中,请单击左侧边栏上的“监视”图标。If you're already in the ADF UX, click on the Monitor icon on the left sidebar.
默认情况下,所有数据工厂运行都以浏览器的本地时区显示。By default, all data factory runs are displayed in the browser's local time zone. 如果你更改时区,所有日期/时间字段都会与你选择的时区保持一致。If you change the time zone, all the date/time fields snap to the one that you selected.
监视管道运行Monitor pipeline runs
默认监视视图是所选时段内触发的管道运行的列表。The default monitoring view is list of triggered pipeline runs in the selected time period. 你可以更改时间范围并按状态、管道名称或注释进行筛选。You can change the time range and filter by status, pipeline name, or annotation. 将鼠标悬停在特定管道运行上可获取特定于运行的操作,如重新运行和消耗报告。Hover over the specific pipeline run to get run-specific actions such as rerun and the consumption report.
管道运行网格包含以下列:The pipeline run grid contains the following columns:
列名Column name | 说明Description |
---|---|
管道名称Pipeline Name | 管道的名称Name of the pipeline |
运行开始时间Run Start | 管道运行的开始日期和时间(MM/DD/YYYY,HH:MM:SS AM/PM)Start date and time for the pipeline run (MM/DD/YYYY, HH:MM:SS AM/PM) |
运行结束时间Run End | 管道运行的结束日期和时间(MM/DD/YYYY,HH:MM:SS AM/PM)End date and time for the pipeline run (MM/DD/YYYY, HH:MM:SS AM/PM) |
持续时间Duration | 运行持续时间 (HH:MM:SS)Run duration (HH:MM:SS) |
触发者Triggered By | 启动了管道的触发器的名称The name of the trigger that started the pipeline |
状态Status | 失败、成功、正在进行、已取消 或 已排队Failed, Succeeded, In Progress, Canceled, or Queued |
批注Annotations | 与管道关联的可筛选标记Filterable tags associated with a pipeline |
参数Parameters | 管道运行的参数(名称/值对)Parameters for the pipeline run (name/value pairs) |
错误Error | 在管道失败的情况下出现的运行错误If the pipeline failed, the run error |
运行 IDRun ID | 管道运行的 IDID of the pipeline run |
需要手动选择“刷新”按钮来刷新管道和活动运行的列表。You need to manually select the Refresh button to refresh the list of pipeline and activity runs. 当前不支持自动刷新。Autorefresh is currently not supported.
若要查看调试运行的结果,请选择“调试”选项卡。To view the results of a debug run, select the Debug tab.
监视活动运行Monitor activity runs
若要获取某特定管道运行的单个活动运行的详细视图,请单击管道名称。To get a detailed view of the individual activity runs of a specific pipeline run, click on the pipeline name.
此列表视图显示了与每个管道运行对应的活动运行。The list view shows activity runs that correspond to each pipeline run. 将鼠标悬停在该特定活动运行上可获取特定于运行的信息,如 JSON 输入、JSON 输出和详细的特定于活动的监视体验。Hover over the specific activity run to get run-specific information such as the JSON input, JSON output, and detailed activity-specific monitoring experiences.
列名Column name | 说明Description |
---|---|
活动名称Activity Name | 管道中的活动的名称Name of the activity inside the pipeline |
活动类型Activity Type | 活动类型,例如“复制”、“HDInsightSpark”或“HDInsightHive”。Type of the activity, such as Copy, HDInsightSpark, or HDInsightHive |
操作Actions | 图标,用于查看 JSON 输入信息、JSON 输出信息或详细的特定于活动的监视体验Icons that allow you to see JSON input information, JSON output information, or detailed activity-specific monitoring experiences |
运行开始时间Run Start | 活动运行的开始日期和时间(MM/DD/YYYY,HH:MM:SS AM/PM)Start date and time for the activity run (MM/DD/YYYY, HH:MM:SS AM/PM) |
持续时间Duration | 运行持续时间 (HH:MM:SS)Run duration (HH:MM:SS) |
状态Status | 失败、成功、正在进行 或 已取消Failed, Succeeded, In Progress, or Canceled |
Integration RuntimeIntegration Runtime | 运行活动时所在的 Integration RuntimeWhich Integration Runtime the activity was run on |
用户属性User Properties | 活动的用户定义属性User-defined properties of the activity |
错误Error | 在活动失败的情况下出现的运行错误If the activity failed, the run error |
运行 IDRun ID | 活动运行的 IDID of the activity run |
如果某个活动失败,可通过单击错误列中的图标来查看详细的错误消息。If an activity failed, you can see the detailed error message by clicking on the icon in the error column.
提升要监视的用户属性Promote user properties to monitor
将任何管道活动属性提升为用户属性,使其成为受监视的实体。Promote any pipeline activity property as a user property so that it becomes an entity that you monitor. 例如,可以将管道中复制活动的“源”和“目标”属性提升为用户属性。For example, you can promote the Source and Destination properties of the copy activity in your pipeline as user properties.
备注
最多只能将五个管道活动属性提升为用户属性。You can only promote up to five pipeline activity properties as user properties.
创建用户属性后,便可在监视列表视图中监视它们。After you create the user properties, you can monitor them in the monitoring list views.
如果复制活动的源是表名,则可以将源表名称作为活动运行列表视图中的列进行监视。If the source for the copy activity is a table name, you can monitor the source table name as a column in the list view for activity runs.
重新运行管道和活动Rerun pipelines and activities
若要从开始处重新运行之前已运行过的管道,请将鼠标悬停在该特定管道运行上,并选择“重新运行”。To rerun a pipeline that has previously ran from the start, hover over the specific pipeline run and select Rerun. 如果选择多个管道,可以使用“重新运行”按钮来运行所有这些管道。If you select multiple pipelines, you can use the Rerun button to run them all.
如果需要从某个特定点开始重新运行,可从活动运行视图中执行此操作。If you wish to rerun starting at a specific point, you can do so from the activity runs view. 选择需要作为开始位置的活动,并选择“从活动重新运行”。Select the activity you wish to start from and select Rerun from activity.
从失败的活动重新运行Rerun from failed activity
如果某个活动失败、超时或被取消,则可以通过选择“从失败的活动重新运行”来从该失败的活动重新运行管道。If an activity fails, times out, or is canceled, you can rerun the pipeline from that failed activity by selecting Rerun from failed activity.
查看重新运行历史记录View rerun history
可以查看列表视图中所有管道运行的重新运行历史记录。You can view the rerun history for all the pipeline runs in the list view.
还可以查看特定管道运行的重新运行历史记录。You can also view rerun history for a particular pipeline run.
监视消耗Monitor consumption
通过单击管道运行旁边的消耗图标,可以查看运行消耗的资源。You can see the resources consumed by a pipeline run by clicking the consumption icon next to the run.
单击此图标会打开相应管道运行所使用的资源的消耗报告。Clicking the icon opens a consumption report of resources used by that pipeline run.
可以将这些值插入到 Azure 定价计算器中,以估计管道运行的成本。You can plug these values into the Azure pricing calculator to estimate the cost of the pipeline run. 若要详细了解 Azure 数据工厂定价,请参阅了解定价。For more information on Azure Data Factory pricing, see Understanding pricing.
备注
定价计算器返回的这些值是估计值。These values returned by the pricing calculator is an estimate. 它并不反映 Azure 数据工厂将向你收取的确切金额It doesn't reflect the exact amount you will be billed by Azure Data Factory
甘特视图Gantt views
甘特图是一种可用于查看某个时间范围内的运行历史记录的视图。A Gantt chart is a view that allows you to see the run history over a time range. 切换到甘特视图后,将会看到所有管道运行都按名称分组,并显示为与运行所用时间长度相关的条形。By switching to a Gantt view, you will see all pipeline runs grouped by name displayed as bars relative to how long the run took. 还可以按已在管道上创建的注释/标记进行分组。You can also group by annotations/tags that you've create on your pipeline. 在活动运行级别也可使用甘特视图。The Gantt view is also available at the activity run level.
条形长度表示管道持续时间。The length of the bar informs the duration of the pipeline. 还可以选择条形来查看更多详细信息。You can also select the bar to see more details.
警报Alerts
可在数据工厂中发出有关受支持指标的警报。You can raise alerts on supported metrics in Data Factory. 在“数据工厂监视”页上,依次选择“监视” > “警报和指标”,以开始操作。Select Monitor > Alerts & metrics on the Data Factory monitoring page to get started.
创建警报Create alerts
选择“新建警报规则”,以新建警报。Select New alert rule to create a new alert.
指定规则名称,然后选择警报严重性。Specify the rule name and select the alert severity.
选择警报条件。Select the alert criteria.
可以针对各种指标创建警报,包括 ADF 实体计数/大小、活动/管道/触发器运行、Integration Runtime (IR) CPU 利用率/内存/节点计数/队列,以及 SSIS 包执行和 SSIS IR 启动/停止操作的指标。You can create alerts on various metrics, including those for ADF entity count/size, activity/pipeline/trigger runs, Integration Runtime (IR) CPU utilization/memory/node count/queue, as well as for SSIS package executions and SSIS IR start/stop operations.
配置警报逻辑。Configure the alert logic. 可以针对所选的指标为所有管道和对应的活动创建警报。You can create an alert for the selected metric for all pipelines and corresponding activities. 还可以选择特定的活动类型、活动名称、管道名称或故障类型。You can also select a particular activity type, activity name, pipeline name, or failure type.
为警报配置电子邮件、短信、推送和语音通知。Configure email, SMS, push, and voice notifications for the alert. 为警报通知创建一个操作组,或选择现有的操作组。Create an action group, or choose an existing one, for the alert notifications.
创建警报规则。Create the alert rule.
后续步骤Next steps
若要了解有关监视和管理管道的信息,请参阅以编程方式监视和管理管道一文。To learn about monitoring and managing pipelines, see the Monitor and manage pipelines programmatically article.