在 Azure 数据工厂中预配 Azure-SSIS 集成运行时Provision the Azure-SSIS integration runtime in Azure Data Factory

本教程提供使用 Azure 门户在 Azure 数据工厂中预配 Azure-SQL Server Integration Services (SSIS) 集成运行时 (IR) 的步骤。This tutorial provides steps for using the Azure portal to provision an Azure-SQL Server Integration Services (SSIS) integration runtime (IR) in Azure Data Factory. Azure-SSIS IR 支持:An Azure-SSIS IR supports:

  • 运行部署在由 Azure SQL 数据库服务器或托管实例承载的 SSIS 目录 (SSISDB) 中的包(项目部署模型)。Running packages deployed into the SSIS catalog (SSISDB) hosted by an Azure SQL Database server or a managed instance (Project Deployment Model).
  • 运行部署在文件系统、文件共享或 Azure 文件存储中的包(包部署模型)。Running packages deployed into file systems, file shares, or Azure Files (Package Deployment Model).

预配 Azure-SSIS IR 后,可以使用熟悉的工具在 Azure 中部署和运行包。After an Azure-SSIS IR is provisioned, you can use familiar tools to deploy and run your packages in Azure. 这些工具包括 SQL Server Data Tools (SSDT)、SQL Server Management Studio (SSMS) 和命令行工具(例如 dtinstalldtutildtexec)。These tools include SQL Server Data Tools (SSDT), SQL Server Management Studio (SSMS), and command-line tools like dtinstall, dtutil, and dtexec.

有关 Azure-SSIS IR 的概念性信息,请参阅 Azure-SSIS 集成运行时概述For conceptual information on Azure-SSIS IRs, see Azure-SSIS integration runtime overview.

在本教程中,将完成以下步骤:In this tutorial, you complete the following steps:

  • 创建数据工厂。Create a data factory.
  • 预配 Azure-SSIS 集成运行时。Provision an Azure-SSIS integration runtime.

先决条件Prerequisites

Note

本文进行了更新,以便使用新的 Azure PowerShell Az 模块。This article has been updated to use the new Azure PowerShell Az module. 你仍然可以使用 AzureRM 模块,至少在 2020 年 12 月之前,它将继续接收 bug 修补程序。You can still use the AzureRM module, which will continue to receive bug fixes until at least December 2020. 若要详细了解新的 Az 模块和 AzureRM 兼容性,请参阅新 Azure Powershell Az 模块简介To learn more about the new Az module and AzureRM compatibility, see Introducing the new Azure PowerShell Az module. 有关 Az 模块安装说明,请参阅安装 Azure PowerShellFor Az module installation instructions, see Install Azure PowerShell.

  • Azure 订阅Azure subscription. 如果没有 Azure 订阅,可在开始前创建一个 1 元人民币试用帐户If you don't have an Azure subscription, create a 1rmb trial account before you begin.

  • Azure SQL 数据库服务器(可选)Azure SQL Database server (optional). 如果还没有数据库服务器,请在启动之前在 Azure 门户中创建一个。If you don't already have a database server, create one in the Azure portal before you get started. 数据工厂进而会在此数据库服务器上创建一个 SSISDB 实例。Data Factory will in turn create an SSISDB instance on this database server.

    建议在集成运行时所在的同一 Azure 区域中创建数据库服务器。We recommend that you create the database server in the same Azure region as the integration runtime. 此配置允许集成运行时将执行日志写入 SSISDB 而无需跨 Azure 区域。This configuration lets the integration runtime write execution logs into SSISDB without crossing Azure regions.

    请记住以下几点:Keep these points in mind:

    • 根据所选的数据库服务器,系统可以代表你创建 SSISDB 实例作为单一数据库或创建此实例作为弹性池的一部分。Based on the selected database server, or the SSISDB instance can be created on your behalf as a single database, as part of an elastic pool. 可以在公用网络中访问或者通过加入虚拟网络来访问该实例。It can be accessible in a public network or by joining a virtual network.

      如果使用具有 IP 防火墙规则/虚拟网络服务终结点的 Azure SQL 数据库服务器或具有专用终结点的托管实例来承载 SSISDB,或者需要在未配置自承载 IR 的情况下访问本地数据,则需要将 Azure-SSIS IR 加入虚拟网络。If you use an Azure SQL Database server with IP firewall rules/virtual network service endpoints or a managed instance with private endpoint to host SSISDB, or if you require access to on-premises data without configuring a self-hosted IR, you need to join your Azure-SSIS IR to a virtual network. 有关详细信息,请参阅在虚拟网络中创建 Azure-SSIS IRFor more information, see Create an Azure-SSIS IR in a virtual network.

    • 确认为数据库服务器启用了“允许访问 Azure 服务”设置。 Confirm that the Allow access to Azure services setting is enabled for the database server. 使用具有 IP 防火墙规则/虚拟网络服务终结点的 Azure SQL 数据库服务器或具有专用终结点的托管实例来承载 SSISDB 时,此设置并不适用。This setting is not applicable when you use an Azure SQL Database server with IP firewall rules/virtual network service endpoints or a managed instance with private endpoint to host SSISDB. 有关详细信息,请参阅保护 Azure SQL 数据库For more information, see Secure your Azure SQL database. 若要通过 PowerShell 来启用此设置,请参阅 New-AzSqlServerFirewallRuleTo enable this setting by using PowerShell, see New-AzSqlServerFirewallRule.

    • 将客户端计算机的 IP 地址或一系列包括客户端计算机 IP 地址的 IP 地址添加到数据库服务器的防火墙设置中的客户端 IP 地址列表。Add the IP address of the client machine, or a range of IP addresses that includes the IP address of the client machine, to the client IP address list in the firewall settings for the database server. 有关详细信息,请参阅 Azure SQL 数据库服务器级和数据库级防火墙规则For more information, see Azure SQL Database server-level and database-level firewall rules.

    • 若要连接到数据库服务器,可以结合服务器管理员凭据使用 SQL 身份验证,或者结合数据工厂的托管标识使用 Azure AD 身份验证。You can connect to the database server by using SQL authentication with your server admin credentials, or by using Azure AD authentication with the managed identity for your data factory. 对于后者,需将数据工厂的托管标识添加到有权访问数据库服务器的 Azure AD 组中。For the latter, you need to add the managed identity for your data factory into an Azure AD group with access permissions to the database server. 有关详细信息,请参阅使用 Azure AD 身份验证创建 Azure-SSIS IRFor more information, see Create an Azure-SSIS IR with Azure AD authentication.

    • 确认你的数据库服务器还没有 SSISDB 实例。Confirm that your database server does not have an SSISDB instance already. 预配 Azure-SSIS IR 时不支持使用现有的 SSISDB 实例。The provisioning of an Azure-SSIS IR does not support using an existing SSISDB instance.

Note

如需目前提供数据工厂和 Azure-SSIS IR 的 Azure 区域的列表,请参阅数据工厂和 SSIS IR 在各区域的上市情况For a list of Azure regions in which Data Factory and an Azure-SSIS IR are currently available, see Data Factory and SSIS IR availability by region.

创建数据工厂Create a data factory

若要通过 Azure 门户创建数据工厂,请按照通过 UI 创建数据工厂中的分步说明操作。To create your data factory via the Azure portal, follow the step-by-step instructions in Create a data factory via the UI. 执行此操作时,请选择“固定到仪表板”,以便在创建后能够快速访问数据工厂。 Select Pin to dashboard while doing so, to allow quick access after its creation.

创建数据工厂后,在 Azure 门户中打开其概述页。After your data factory is created, open its overview page in the Azure portal. 选择“创建和监视”磁贴,在单独的选项卡中打开“开始”页。 然后可以继续创建 Azure-SSIS IR。Select the Author & Monitor tile to open the Let's get started page on a separate tab. There, you can continue to create your Azure-SSIS IR.

创建 Azure-SSIS 集成运行时Create an Azure-SSIS integration runtime

使用数据工厂概览From the Data Factory overview

  1. 在“入门”页中,选择“配置 SSIS 集成运行时”磁贴。 On the Let's get started page, select the Configure SSIS Integration Runtime tile.

    “配置 Azure SSIS 集成运行时”磁贴

  2. 请参阅预配 Azure-SSIS 集成运行时部分,了解用于设置 Azure-SSIS IR 的剩余步骤。For the remaining steps to set up an Azure-SSIS IR, see the Provision an Azure-SSIS integration runtime section.

使用创作 UIFrom the authoring UI

  1. 在 Azure 数据工厂 UI 中切换到“编辑”选项卡,选择“连接”。 In the Azure Data Factory UI, switch to the Edit tab and select Connections. 然后切换到“集成运行时”选项卡以查看数据工厂中的现有集成运行时。 Then switch to the Integration Runtimes tab to view existing integration runtimes in your data factory.

    用于查看现有 IR 的选择

  2. 选择“新建”以创建 Azure-SSIS IR。 Select New to create an Azure-SSIS IR.

    通过菜单创建集成运行时

  3. 在“集成运行时安装”面板中选择“直接迁移现有的 SSIS 包以在 Azure 中执行”磁贴,然后选择“下一步”。 In the Integration Runtime Setup panel, select the Lift-and-shift existing SSIS packages to execute in Azure tile, and then select Next.

    指定集成运行时的类型

  4. 请参阅预配 Azure-SSIS 集成运行时部分,了解用于设置 Azure-SSIS IR 的剩余步骤。For the remaining steps to set up an Azure-SSIS IR, see the Provision an Azure-SSIS integration runtime section.

预配 Azure-SSIS 集成运行时Provision an Azure-SSIS integration runtime

  1. 在“集成运行时安装”面板的“常规设置”部分完成以下步骤。 On the General Settings section of Integration Runtime Setup panel, complete the following steps.

    常规设置

    1. 对于“名称”,请输入集成运行时的名称。 For Name, enter the name of your integration runtime.

    2. 对于“说明”,请输入集成运行时的说明。 For Description, enter the description of your integration runtime.

    3. 对于“位置”,请选择集成运行时的位置。 For Location, select the location of your integration runtime. 界面上仅显示支持的位置。Only supported locations are displayed. 建议选择承载 SSISDB 所需的数据库服务器的位置。We recommend that you select the same location of your database server to host SSISDB.

    4. 对于“节点大小”,请选择集成运行时群集中的节点大小 。For Node Size, select the size of node in your integration runtime cluster. 仅显示支持的节点大小。Only supported node sizes are displayed. 如果需要运行多个计算密集型或内存密集型包,请选择较大的节点大小(纵向扩展)。Select a large node size (scale up) if you want to run many compute-intensive or memory-intensive packages.

    5. 对于“节点数”,请选择集成运行时群集中的节点数 。For Node Number, select the number of nodes in your integration runtime cluster. 仅显示支持的节点数。Only supported node numbers are displayed. 如果需要并行运行多个包,请选择包含许多节点的大型群集(横向扩展)。Select a large cluster with many nodes (scale out) if you want to run many packages in parallel.

    6. 对于“版本/许可证”,请选择集成运行时的 SQL Server 版本: “标准”或“企业”。For Edition/License, select the SQL Server edition for your integration runtime: Standard or Enterprise. 如果需要在集成运行时上使用高级功能,请选择“Enterprise”。Select Enterprise if you want to use advanced features on your integration runtime.

    7. 对于“节省资金”,请选择适用于集成运行时的“Azure 混合权益”选项: “是”或“否”。 For Save Money, select the Azure Hybrid Benefit option for your integration runtime: Yes or No. 如果需要自带具有软件保障的 SQL Server 许可证,以便充分利用使用混合权益带来的成本节省,请选择“是”。 Select Yes if you want to bring your own SQL Server license with Software Assurance to benefit from cost savings with hybrid use.

    8. 选择“下一步”。Select Next.

  2. 在“SQL 设置”部分完成以下步骤。 On the SQL Settings section, complete the following steps.

    SQL 设置

    a.a. 选中“创建 SSIS 目录...”复选框,选择要在 Azure-SSIS IR 中运行的包的部署模型。 Select the Create SSIS catalog... check box to choose the deployment model for packages to run on your Azure-SSIS IR. 选择“项目部署模型”(其中的包将部署到数据库服务器承载的 SSISDB)或“包部署模型”(其中的包将部署到文件系统、文件共享或 Azure 文件)。You'll choose either the Project Deployment Model where packages are deployed into SSISDB hosted by your database server, or the Package Deployment Model where packages are deployed into file systems, file shares, or Azure Files.

    如果选中该复选框,需要提供自己的数据库服务器来承载我们将代表你创建和管理的 SSISDB。If you select the check box, you'll need to bring your own database server to host SSISDB that we'll create and manage on your behalf.

    1. 对于“订阅”,请选择使用数据库服务器来托管 SSISDB 的 Azure 订阅。 For Subscription, select the Azure subscription that has your database server to host SSISDB.

    2. 对于“位置”,请选择用于托管 SSISDB 的数据库服务器的位置。 For Location, select the location of your database server to host SSISDB. 建议选择集成运行时的位置。We recommend that you select the same location of your integration runtime.

    3. 对于“目录数据库服务器终结点”,请选择用于承载 SSISDB 的数据库服务器的终结点。 For Catalog Database Server Endpoint, select the endpoint of your database server to host SSISDB.

      根据所选的数据库服务器,系统可以代表你创建 SSISDB 实例作为单一数据库或创建此实例作为弹性池的一部分。Based on the selected database server, the SSISDB instance can be created on your behalf as a single database, or as part of an elastic pool. 可以在公用网络中访问或者通过加入虚拟网络来访问该实例。It can be accessible in a public network or by joining a virtual network.

      如果选择具有 IP 防火墙规则/虚拟网络服务终结点的 Azure SQL 数据库服务器或具有专用终结点的托管实例来承载 SSISDB,或者需要在未配置自承载 IR 的情况下访问本地数据,则需要将 Azure-SSIS IR 加入虚拟网络。If you select an Azure SQL Database server with IP firewall rules/virtual network service endpoints or a managed instance with private endpoint to host SSISDB, or if you require access to on-premises data without configuring a self-hosted IR, you need to join your Azure-SSIS IR to a virtual network. 有关详细信息,请参阅在虚拟网络中创建 Azure-SSIS IRFor more information, see Create an Azure-SSIS IR in a virtual network.

    4. 选中“结合 ADF 的托管标识使用 AAD 身份验证”复选框,选择数据库服务器用来承载 SSISDB 的身份验证方法。 Select the Use AAD authentication with the managed identity for your ADF check box to choose the authentication method for your database server to host SSISDB. 选择使用数据工厂的托管标识进行 SQL 身份验证或 Azure AD 身份验证。You'll choose either SQL authentication or Azure AD authentication with the managed identity for your data factory.

      如果选中该复选框,需将数据工厂的托管标识添加到有权访问数据库服务器的 Azure AD 组中。If you select the check box, you'll need to add the managed identity for your data factory into an Azure AD group with access permissions to your database server. 有关详细信息,请参阅使用 Azure AD 身份验证创建 Azure-SSIS IRFor more information, see Create an Azure-SSIS IR with Azure AD authentication.

    5. 对于“管理员用户名”,请输入用于承载 SSISDB 的数据库服务器的 SQL 身份验证用户名。 For Admin Username, enter the SQL authentication username for your database server to host SSISDB.

    6. 对于“管理员密码”,请输入用于承载 SSISDB 的数据库服务器的 SQL 身份验证密码。 For Admin Password, enter the SQL authentication password for your database server to host SSISDB.

    7. 对于“目录数据库服务层级”,请选择用于承载 SSISDB 的数据库服务器的服务层级。 For Catalog Database Service Tier, select the service tier for your database server to host SSISDB. 选择“基本”、“标准”或“高级”层级,或选择弹性池名称。Select the Basic, Standard, or Premium tier, or select an elastic pool name.

    8. 选择“测试连接” 。Select Test Connection. 如果测试成功,请选择“下一步”。 If the test is successful, select Next.

  3. 在“高级设置”部分完成以下步骤。 On the Advanced Settings section, complete the following steps.

    高级设置

    1. 对于“每个节点的最大并行执行数”,请选择要在集成运行时群集中并发运行的最大包数(按节点)。 For Maximum Parallel Executions Per Node, select the maximum number of packages to run concurrently per node in your integration runtime cluster. 仅显示支持的包数。Only supported package numbers are displayed. 如果需要使用多个核心来运行单个计算密集型或内存密集型的大型包,请选择较小的数字。Select a low number if you want to use more than one core to run a single large package that's compute or memory intensive. 如果需要在单个核心中运行一个或多个小型包,请选择较大的数字。Select a high number if you want to run one or more small packages in a single core.

    2. 选中“使用其他系统配置/组件安装自定义 Azure-SSIS Integration Runtime”复选框,以选择是否要在 Azure-SSIS IR 中添加标准/快速自定义安装。 Select the Customize your Azure-SSIS Integration Runtime with additional system configurations/component installations check box to choose whether you want to add standard/express custom setups on your Azure-SSIS IR. 有关详细信息,请参阅 Azure-SSIS IR 的自定义安装For more information, see Custom setup for an Azure-SSIS IR.

    3. 选中“选择 Azure-SSIS 集成运行时要加入到的 VNet,允许 ADF 创建特定的网络资源,并提供自己的静态公共 IP 地址(可选)”复选框,选择是否要将 Azure-SSIS IR 加入虚拟网络。 Select the Select a VNet for your Azure-SSIS Integration Runtime to join, allow ADF to create certain network resources, and optionally bring your own static public IP addresses check box to choose whether you want to join your Azure-SSIS IR to a virtual network.

      如果使用具有 IP 防火墙规则/虚拟网络服务终结点的 Azure SQL 数据库服务器或具有专用终结点的托管实例来承载 SSISDB,或者需要在未配置自承载 IR 的情况下访问本地数据,请选中此复选框。Select it if you use an Azure SQL Database server with IP firewall rules/virtual network service endpoints or a managed instance with private endpoint to host SSISDB, or if you require access to on-premises data without configuring a self-hosted IR. 有关详细信息,请参阅在虚拟网络中创建 Azure-SSIS IRFor more information, see Create an Azure-SSIS IR in a virtual network.

    4. 选择“继续”。 Select Continue.

  4. 在“摘要”部分检查所有预配设置,将建议的文档链接添加为书签,然后选择“完成”开始创建集成运行时。 On the Summary section, review all provisioning settings, bookmark the recommended documentation links, and select Finish to start the creation of your integration runtime.

    Note

    此过程应在 5 分钟内完成(不包括任何自定义安装时间)。Excluding any custom setup time, this process should finish within 5 minutes.

    如果使用 SSISDB,数据工厂服务将连接到数据库服务器以准备 SSISDB。If you use SSISDB, the Data Factory service will connect to your database server to prepare SSISDB.

    预配 Azure-SSIS IR 时,还会安装 Access Redistributable 和 Azure Feature Pack for SSIS。When you provision an Azure-SSIS IR, Access Redistributable and Azure Feature Pack for SSIS are also installed. 除了内置组件已支持的数据源外,这些组件还提供与 Excel 文件、Access 文件和各种 Azure 数据源的连接。These components provide connectivity to Excel files, Access files, and various Azure data sources, in addition to the data sources that built-in components already support. 有关可安装的其他组件的信息,请参阅 Azure-SSIS IR 的自定义安装For information about other components that you can install, see Custom setup for an Azure-SSIS IR.

  5. 在“连接”选项卡中,根据需要切换到“集成运行时”。 On the Connections tab, switch to Integration Runtimes if needed. 选择“刷新”可刷新状态。 Select Refresh to refresh the status.

    创建状态,使用“刷新”按钮

  6. 使用“操作”列中的链接可以停止/启动、编辑或删除集成运行时。 Use the links in the Actions column to stop/start, edit, or delete the integration runtime. 使用最后一个链接可以查看集成运行时的 JSON 代码。Use the last link to view JSON code for the integration runtime. 仅当 IR 已停止时,才会启用编辑和删除按钮。The edit and delete buttons are enabled only when the IR is stopped.

    “操作”列中的链接

部署 SSIS 包Deploy SSIS packages

如果使用 SSISDB,可将包部署到其中,并使用 SQL Server Data Tools (SSDT) 或 SQL Server Management Studio (SSMS) 工具在 Azure-SSIS IR 上运行这些包。If you use SSISDB, you can deploy your packages into it and run them on the Azure-SSIS IR by using SQL Server Data Tools (SSDT) or SQL Server Management Studio (SSMS) tools. 这些工具通过数据库服务器的服务器终结点来与该服务器建立连接:These tools connect to your database server via its server endpoint:

  • 对于 Azure SQL 数据库服务器,服务器终结点格式为 <server name>.database.chinacloudapi.cnFor an Azure SQL Database server, the server endpoint format is <server name>.database.chinacloudapi.cn.
  • 对于具有专用终结点的托管实例,服务器终结点格式为 <server name>.<dns prefix>.database.chinacloudapi.cnFor a managed instance with private endpoint, the server endpoint format is <server name>.<dns prefix>.database.chinacloudapi.cn.
  • 对于具有公共终结点的托管实例,服务器终结点格式为 <server name>.public.<dns prefix>.database.chinacloudapi.cn,3342For a managed instance with public endpoint, the server endpoint format is <server name>.public.<dns prefix>.database.chinacloudapi.cn,3342.

如果不使用 SSISDB,则可以将包部署到文件系统、文件共享或 Azure 文件存储中,并使用 dtinstalldtutildtexec 命令行工具在 Azure-SSIS IR 上运行它们。If you don't use SSISDB, you can deploy your packages into file systems, file shares, or Azure Files and run them on the Azure-SSIS IR by using the dtinstall, dtutil, and dtexec command-line tools. 有关详细信息,请参阅部署 SSIS 包For more information, see Deploy SSIS packages.

在这两种情况下,还可以使用数据工厂管道中的“执行 SSIS 包”活动在 Azure-SSIS IR 上运行已部署的包。In both cases, you can also run your deployed packages on Azure-SSIS IR by using the Execute SSIS Package activity in Data Factory pipelines. 有关详细信息,请参阅以第一类数据工厂活动的形式调用 SSIS 包执行For more information, see Invoke SSIS package execution as a first-class Data Factory activity.

另请参阅以下 SSIS 文档:See also the following SSIS documentation:

后续步骤Next steps

若要了解如何自定义 Azure-SSIS Integration Runtime,请参阅下文:To learn about customizing your Azure-SSIS integration runtime, advance to the following article: