Data transfer for large datasets with low or no network bandwidth

This article provides an overview of the data transfer solutions when you have limited to no network bandwidth in your environment and you are planning to transfer large data sets. The article also describes the recommended data transfer options and the respective key capability matrix for this scenario.

To understand an overview of all the available data transfer options, go to Choose an Azure data transfer solution.

Offline transfer or network transfer

Large datasets imply that you have few TBs to few PBs of data. You have limited to no network bandwidth, your network is slow, or it is unreliable. Also:

• You are limited by costs of network transfer from your Internet Service Providers (ISPs).
• Security or organizational policies do not allow outbound connections when dealing with sensitive data.

In all the above instances, use a physical device to do a one-time bulk data transfer. Choose Data Box Disk devices which are supplied by Azure, or Import/Export using your own disks.

To confirm whether a physical device is the right option, use the following table. It shows the projected time for network data transfer, for various available bandwidths (assuming 90% utilization). If network transfer is projected to be too slow, you should use a physical device.

Recommended options

The options available in this scenario are devices for Azure Data Box offline transfer or Azure Import/Export.

• Azure Data Box family for offline transfers – Use devices from Azure-supplied Data Box devices to move large amounts of data to Azure when you're limited by time, network availability, or costs. Copy on-premises data using tools such as Robocopy. Depending on the data size intended for transfer, you can choose Data Box Disk.
• Azure Import/Export – Use Azure Import/Export service by shipping your own disk drives to securely import large amounts of data to Azure Blob storage and Azure Files. This service can also be used to transfer data from Azure Blob storage to disk drives and ship to your on-premises sites.

Comparison of key capabilities

The following table summarizes the differences in key capabilities.

* Data Box Disk does not support Large File Shares and does not preserve file metadata.

Next steps

• Understand how to

  • Transfer data with Data Box Disk.
  • Transfer data with Import/Export.