定期数据传输解决方案Solutions for periodic data transfer

本文概述用于定期传输数据的数据传输解决方案。This article provides an overview of the data transfer solutions when you are transferring data periodically. 通过网络定期传输数据可分为两类:定期传输或持续性数据移动。Periodic data transfer over the network can be categorized as recurring at regular intervals or continuous data movement. 本文还介绍了针对此情况的推荐数据传输选项和相应的关键功能矩阵。The article also describes the recommended data transfer options and the respective key capability matrix for this scenario.

若要查看所有可用数据传输选项的概述,请转到选择一个 Azure 数据传输解决方案To understand an overview of all the available data transfer options, go to Choose an Azure data transfer solution.

推荐的定期数据传输选项根据传输性质(定期或持续)分为两类。The recommended options for periodic data transfer fall into two categories depending on whether the transfer is recurring or continuous.

  • 脚本/编程工具**** - 对于定期发生的数据传输,请使用 AzCopy 和 Azure 存储 REST API 等脚本及编程工具。Scripted/programmatic tools – For data transfer that occurs at regular intervals, use the scripted and programmatic tools such as AzCopy and Azure Storage REST APIs. 这些工具均面向 IT 专业人员和开发人员。These tools are targeted towards IT professionals and developers.

    • AzCopy**** - 使用此命令行工具在保证最佳性能的同时轻松向/从 Azure Blob、文件和表存储复制数据。AzCopy - Use this command-line tool to easily copy data to and from Azure Blobs, Files, and Table storage with optimal performance. AzCopy 支持并发度和并行度,并且可以在复制操作中断后进行恢复。AzCopy supports concurrency and parallelism, and the ability to resume copy operations when interrupted.
    • Azure 存储 REST API/SDK**** - 生成应用程序时,可以对照着 Azure 存储 REST API 开发应用程序,并使用以多种语言提供的 Azure SDK。Azure Storage REST APIs/SDKs – When building an application, you can develop the application against Azure Storage REST APIs and use the Azure SDKs offered in multiple languages. REST API 还可以利用 Azure 存储数据移动库该库专为高性能设计,用于将数据复制到 Azure 和从 Azure 复制数据。The REST APIs can also leverage the Azure Storage Data Movement Library designed especially for the high-performance copying of data to and from Azure.
  • 连续数据引入工具 - 对于连续的持续数据引入,可以选择 Azure 数据工厂。Continuous data ingestion tools – For continuous, ongoing data ingestion, you can select Azure Data Factory. 这些工具是由 IT 专业人员设置的,能以透明的方式自动执行数据传输。These tools are set up by IT professionals and can transparently automate data transfer.

    • Azure 数据工厂 - 如果需要业务流程和企业级监视功能,应使用数据工厂横向扩展传输操作。Azure Data Factory – Data Factory should be used to scale out a transfer operation, and if there is a need for orchestration and enterprise grade monitoring capabilities. 使用 Azure 数据工厂设置一个云管道,在多个 Azure 服务之间、本地或这两者的组合之间定期传输文件。Use Azure Data Factory to set up a cloud pipeline that regularly transfers files between several Azure services, on-premises, or a combination of the two. 通过 Azure 数据工厂,可以安排数据驱动的工作流,该工作流从不同的数据存储引入数据并自动执行数据移动和数据转换。Azure Data Factory lets you orchestrate data-driven workflows that ingest data from disparate data stores and automate data movement and data transformation.

关键功能比较Comparison of key capabilities

下表汇总了各项关键功能方面的差异。The following table summarizes the differences in key capabilities.

脚本/编程网络数据传输Scripted/Programmatic network data transfer

功能Capability AzCopyAzCopy Azure 存储 REST APIAzure Storage REST APIs
外形规格Form factor Microsoft 提供的命令行工具Command-line tool from Microsoft 客户对照存储Customers develop against Storage
REST API 使用 Azure 客户端库进行开发REST APIs using Azure client libraries
初始一次性设置Initial one-time setup 最低Minimal 开发工作量中等、可变Moderate, variable development effort
数据格式Data Format Azure Blob、Azure 文件、Azure 表Azure Blobs, Azure Files, Azure Tables Azure Blob、Azure 文件、Azure 表Azure Blobs, Azure Files, Azure Tables
性能Performance 已优化Already optimized 随开发优化Optimize as you develop
定价Pricing 免费,收取数据出口费用Free, data egress charges apply 免费,收取数据出口费用Free, data egress charges apply

网络上的持续数据引入Continuous data ingestion over network

功能Feature Azure 数据工厂Azure Data Factory
外形规格Form factor Azure 门户中的服务,本地代理Service in Azure portal, agent on-premises
硬件Hardware NANA
初始设置工作量Initial setup effort 大(约数天)Large (~days)
数据格式Data Format 支持 70 多个用于数据存储和格式的数据连接器Supports 70+ data connectors for data stores and formats
数据预处理Data pre-processing Yes
本地缓存Local cache
(存储本地数据)(to store on-premises data)
No
从其他云传输Transfer from other clouds Yes
定价Pricing 定价Pricing

后续步骤Next steps