Azure 数据工厂中的 JSON 格式JSON format in Azure Data Factory

• 10/19/2020
• • 

适用于： Azure 数据工厂 Azure Synapse Analytics（预览版）

如果要 分析 JSON 文件或以 JSON 格式写入数据 ，请遵循本文中的说明。Follow this article when you want to parse the JSON files or write the data into JSON format .

以下连接器支持 JSON 格式：Amazon S3、Azure Blob、Azure Data Lake Storage Gen2、Azure 文件存储、文件系统、FTP、Google 云存储、HDFS、HTTP 和 SFTP。JSON format is supported for the following connectors: Amazon S3, Azure Blob, Azure Data Lake Storage Gen2, Azure File Storage, File System, FTP, Google Cloud Storage, HDFS, HTTP, and SFTP.

数据集属性Dataset properties

有关可用于定义数据集的各部分和属性的完整列表，请参阅数据集一文。For a full list of sections and properties available for defining datasets, see the Datasets article. 本部分提供 JSON 数据集支持的属性列表。This section provides a list of properties supported by the JSON dataset.

下面是 Azure Blob 存储上的 JSON 数据集的示例：Below is an example of JSON dataset on Azure Blob Storage:

{
    "name": "JSONDataset",
    "properties": {
        "type": "Json",
        "linkedServiceName": {
            "referenceName": "<Azure Blob Storage linked service name>",
            "type": "LinkedServiceReference"
        },
        "schema": [ < physical schema, optional, retrievable during authoring > ],
        "typeProperties": {
            "location": {
                "type": "AzureBlobStorageLocation",
                "container": "containername",
                "folderPath": "folder/subfolder",
            },
            "compression": {
                "type": "gzip"
            }
        }
    }
}

复制活动属性Copy activity properties

有关可用于定义活动的各部分和属性的完整列表，请参阅管道一文。For a full list of sections and properties available for defining activities, see the Pipelines article. 本部分提供 JSON 源和接收器支持的属性列表。This section provides a list of properties supported by the JSON source and sink.

若要了解如何从 JSON 文件中提取数据并将其映射到接收器数据存储/格式（反之亦然），请参阅架构映射。Learn about how to extract data from JSON files and map to sink data store/format or vice versa from schema mapping.

以 JSON 作为源JSON as source

复制活动的 *source* 节支持以下属性。The following properties are supported in the copy activity *source* section.

formatSettings 下支持的“JSON 读取设置”：Supported JSON read settings under formatSettings:

JSON 作为接收器JSON as sink

复制活动的 *sink* 节支持以下属性。The following properties are supported in the copy activity *sink* section.

formatSettings 下支持的 JSON 写入设置 ：Supported JSON write settings under formatSettings:

JSON 文件模式JSON file patterns

从 JSON 文件复制数据时，复制活动可自动检测并分析以下 JSON 文件模式。When copying data from JSON files, copy activity can automatically detect and parse the following patterns of JSON files. 将数据写入 JSON 文件时，可以在复制活动接收器上配置文件模式。When writing data to JSON files, you can configure the file pattern on copy activity sink.

• 类型 I：setOfObjectsType I: setOfObjects

  每个文件都包含单一对象、JSON Lines 或串联的对象。Each file contains single object, JSON lines, or concatenated objects.

  • 单一对象 JSON 示例single object JSON example

    {
        "time": "2015-04-29T07:12:20.9100000Z",
        "callingimsi": "466920403025604",
        "callingnum1": "678948008",
        "callingnum2": "567834760",
        "switch1": "China",
        "switch2": "Germany"
    }
    

  • JSON Lines（接收器的默认值）JSON Lines (default for sink)

    {"time":"2015-04-29T07:12:20.9100000Z","callingimsi":"466920403025604","callingnum1":"678948008","callingnum2":"567834760","switch1":"China","switch2":"Germany"}
    {"time":"2015-04-29T07:13:21.0220000Z","callingimsi":"466922202613463","callingnum1":"123436380","callingnum2":"789037573","switch1":"US","switch2":"UK"}
    {"time":"2015-04-29T07:13:21.4370000Z","callingimsi":"466923101048691","callingnum1":"678901578","callingnum2":"345626404","switch1":"Germany","switch2":"UK"}
    

  • 串连的 JSON 示例concatenated JSON example

    {
        "time": "2015-04-29T07:12:20.9100000Z",
        "callingimsi": "466920403025604",
        "callingnum1": "678948008",
        "callingnum2": "567834760",
        "switch1": "China",
        "switch2": "Germany"
    }
    {
        "time": "2015-04-29T07:13:21.0220000Z",
        "callingimsi": "466922202613463",
        "callingnum1": "123436380",
        "callingnum2": "789037573",
        "switch1": "US",
        "switch2": "UK"
    }
    {
        "time": "2015-04-29T07:13:21.4370000Z",
        "callingimsi": "466923101048691",
        "callingnum1": "678901578",
        "callingnum2": "345626404",
        "switch1": "Germany",
        "switch2": "UK"
    }
    

• 类型 II：arrayOfObjectsType II: arrayOfObjects

  每个文件包含对象的数组。Each file contains an array of objects.

  [
      {
          "time": "2015-04-29T07:12:20.9100000Z",
          "callingimsi": "466920403025604",
          "callingnum1": "678948008",
          "callingnum2": "567834760",
          "switch1": "China",
          "switch2": "Germany"
      },
      {
          "time": "2015-04-29T07:13:21.0220000Z",
          "callingimsi": "466922202613463",
          "callingnum1": "123436380",
          "callingnum2": "789037573",
          "switch1": "US",
          "switch2": "UK"
      },
      {
          "time": "2015-04-29T07:13:21.4370000Z",
          "callingimsi": "466923101048691",
          "callingnum1": "678901578",
          "callingnum2": "345626404",
          "switch1": "Germany",
          "switch2": "UK"
      }
  ]
  

后续步骤Next steps

• 复制活动概述Copy activity overview
• Lookup 活动Lookup activity
• GetMetadata 活动GetMetadata activity