Azure HDInsight：Azure CLI 示例Azure HDInsight: Azure CLI samples

03/23/2020

本文提供了常见任务的示例脚本。This article provides sample scripts for common tasks. 对于每个示例，请用适当的值更新变量，然后执行命令。For each example, update the variables with the appropriate values, and then execute the command.

先决条件Prerequisites

Azure CLI。Azure CLI. 有关步骤，请参阅安装 Azure CLI。See Install the Azure CLI for steps.
可选：Bash。Optional: Bash. 本文中的示例使用 Windows 10 上的 Bash shell。The examples in this article use the Bash shell on Windows 10. 有关安装步骤，请参阅适用于 Linux 的 Windows 子系统安装指南 - Windows 10。See Windows Subsystem for Linux Installation Guide for Windows 10 for installation steps. 这些示例经过一些细微的修改，即可在 Windows 命令提示符下运行。The examples will work from a Windows Command prompt with some slight modifications.

登录到 Azure。Log in to Azure.

az login

# If you have multiple subscriptions, set the one to use
# az account set --subscription "SUBSCRIPTIONID"

az hdinsight createaz hdinsight create

创建新的群集。Creates a new cluster.

使用现有存储帐户创建群集Create a cluster with an existing storage account

# set variables
export clusterName=CLUSTERNAME
export resourceGroupName=RESOURCEGROUPNAME
export clusterType=hadoop
export httpCredential='PASSWORD'
export AZURE_STORAGE_ACCOUNT=STORAGEACCOUNTNAME

az hdinsight create \
    --name $clusterName \
    --resource-group $resourceGroupName \
    --type $clusterType \
    --http-password $httpCredential \
    --storage-account $AZURE_STORAGE_ACCOUNT

创建包含企业安全性套餐 (ESP) 的群集Create a cluster with the Enterprise Security Package (ESP)

export clusterName=CLUSTERNAME
export resourceGroupName=RESOURCEGROUPNAME
export clusterType=spark
export httpCredential='PASSWORD'
export AZURE_STORAGE_ACCOUNT=STORAGEACCOUNTNAME
export subnet="/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/MyRG/providers/Microsoft.Network/virtualNetworks/MyVnet/subnets/subnet1"
export domain="/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/MyRG/providers/Microsoft.AAD/domainServices/MyDomain.onmicrosoft.com"
export userAssignedIdentity="/subscriptions/00000000-0000-0000-0000-000000000000/resourcegroups/MyMsiRG/providers/Microsoft.ManagedIdentity/userAssignedIdentities/MyMSI"
export domainAccount=MyAdminAccount@MyDomain.onmicrosoft.com
export groupDNS=MyGroup

az hdinsight create \
    --esp \
    --name $clusterName \
    --resource-group $resourceGroupName \
    --type $clusterType \
    --http-password $httpCredential \
    --storage-account $AZURE_STORAGE_ACCOUNT \
    --subnet $subnet \
    --domain $domain \
    --assign-identity $userAssignedIdentity \
    --cluster-admin-account $domainAccount \
    --cluster-users-group-dns $groupDNS

创建具有磁盘加密功能的 Kafka 群集Create a Kafka cluster with disk encryption

export clusterName=CLUSTERNAME
export resourceGroupName=RESOURCEGROUPNAME
export clusterType=kafka
export httpCredential='PASSWORD'
export AZURE_STORAGE_ACCOUNT=STORAGEACCOUNTNAME
export encryptionKeyName=kafkaClusterKey
export encryptionKeyVersion=00000000000000000000000000000000
export encryptionVaultUri=https://MyKeyVault.vault.azure.cn
export userAssignedIdentity="/subscriptions/00000000-0000-0000-0000-000000000000/resourcegroups/MyMsiRG/providers/Microsoft.ManagedIdentity/userAssignedIdentities/MyMSI"

az hdinsight create \
    --name $clusterName \
    --resource-group $resourceGroupName \
    --type $clusterType \
    --http-password $httpCredential \
    --storage-account $AZURE_STORAGE_ACCOUNT \
    --workernode-data-disks-per-node 2 \
    --encryption-key-name $encryptionKeyName \
    --encryption-key-version $encryptionKeyVersion \
    --encryption-vault-uri $encryptionVaultUri \
    --assign-identity $userAssignedIdentity

创建包含 Azure Data Lake Storage Gen2 的群集Create a cluster with Azure Data Lake Storage Gen2

export clusterName=CLUSTERNAME
export resourceGroupName=RESOURCEGROUPNAME
export clusterType=spark
export httpCredential='PASSWORD'
export adlgen2=MyStorageAccount
export sami=MyMSI

az hdinsight create \
    --name $clusterName \
    --resource-group $resourceGroupName \
    --type $clusterType \
    --http-password $httpCredential \
    --storage-account $adlgen2 \
    --storage-account-managed-identity $sami

使用 JSON 字符串中的配置创建群集Create a cluster with configuration from JSON string

export clusterName=CLUSTERNAME
export resourceGroupName=RESOURCEGROUPNAME
export clusterType=spark
export httpCredential='PASSWORD'
export AZURE_STORAGE_ACCOUNT=STORAGEACCOUNTNAME
export clusterConfiguration="{'gateway':{'restAuthCredential.username':'admin'}}"

az hdinsight create \
    --name $clusterName \
    --resource-group $resourceGroupName \
    --type $clusterType \
    --http-password $httpCredential \
    --storage-account $AZURE_STORAGE_ACCOUNT \
    --cluster-configuration $clusterConfiguration

使用本地文件中的配置创建群集Create a cluster with configuration from a local file

export clusterName=CLUSTERNAME
export resourceGroupName=RESOURCEGROUPNAME
export clusterType=spark
export httpCredential='PASSWORD'
export AZURE_STORAGE_ACCOUNT=STORAGEACCOUNTNAME
export clusterConfiguration=@/mnt/c/HDI/config.json

az hdinsight create \
    --name $clusterName \
    --resource-group $resourceGroupName \
    --type $clusterType \
    --http-password $httpCredential \
    --storage-account $AZURE_STORAGE_ACCOUNT \
    --cluster-configuration $clusterConfiguration

az hdinsight application createaz hdinsight application create

为 HDInsight 群集创建应用程序。Create an application for a HDInsight cluster.

使用脚本 URI 创建应用程序Create an application with a script URI

export resourceGroupName=RESOURCEGROUPNAME
export applicationName=MyApplication
export clusterName=CLUSTERNAME
export scriptURI=https://hdiconfigactions.blob.core.windows.net/linuxhueconfigactionv02/install-hue-uber-v02.sh
export scriptActionName=MyScriptAction
export scriptParameters='"-version latest -port 20000"'

az hdinsight application create \
    --resource-group $resourceGroupName \
    --name $applicationName \
    --cluster-name $clusterName \
    --script-uri $scriptURI  \
    --script-action-name $scriptActionName \
    --script-parameters "$scriptParameters"

使用脚本 URI 和指定边缘节点大小创建应用程序Create an application with a script URI and specified edge node size

export resourceGroupName=RESOURCEGROUPNAME
export applicationName=MyApplication
export clusterName=CLUSTERNAME
export scriptURI=https://hdiconfigactions.blob.core.windows.net/linuxhueconfigactionv02/install-hue-uber-v02.sh
export scriptActionName=MyScriptAction
export scriptParameters='"-version latest -port 20000"'
export edgenodeSize=Standard_D4_v2

az hdinsight application create \
    --resource-group $resourceGroupName \
    --name $applicationName \
    --cluster-name $clusterName \
    --script-uri $scriptURI  \
    --script-action-name $scriptActionName \
    --script-parameters "$scriptParameters" \
    --edgenode-size $edgenodeSize

使用 HTTPS 终结点创建应用程序Create an application with HTTPS Endpoint

export resourceGroupName=RESOURCEGROUPNAME
export applicationName=MyApplication
export clusterName=CLUSTERNAME
export scriptURI=https://hdiconfigactions.blob.core.windows.net/linuxhueconfigactionv02/install-hue-uber-v02.sh
export scriptActionName=MyScriptAction
export scriptParameters='"-version latest -port 20000"'
export destinationPort=8888
export subDomainSuffix=was

az hdinsight application create \
    --resource-group $resourceGroupName \
    --name $applicationName \
    --cluster-name $clusterName \
    --script-uri $scriptURI  \
    --script-action-name $scriptActionName \
    --script-parameters "$scriptParameters" \
    --destination-port $destinationPort \
    --sub-domain-suffix $subDomainSuffix

az hdinsight script-action executeaz hdinsight script-action execute

在指定的 HDInsight 群集上执行脚本操作。Execute script actions on the specified HDInsight cluster.

执行脚本操作并在成功时继续Execute a script action and persist on success

export resourceGroupName=RESOURCEGROUPNAME
export clusterName=CLUSTERNAME
export scriptActionName=MyScriptAction
export scriptURI=https://hdiconfigactions.blob.core.windows.net/linuxgiraphconfigactionv01/giraph-installer-v01.sh
export roles="headnode workernode"

az hdinsight script-action execute \
    --resource-group $resourceGroupName \
    --cluster-name $clusterName \
    --name $scriptActionName \
    --script-uri $scriptURI  \
    --roles $roles \
    --persist-on-success

Azure HDInsight：Azure CLI 示例Azure HDInsight: Azure CLI samples

先决条件Prerequisites

az hdinsight createaz hdinsight create

使用现有存储帐户创建群集Create a cluster with an existing storage account

创建包含企业安全性套餐 (ESP) 的群集Create a cluster with the Enterprise Security Package (ESP)

创建具有磁盘加密功能的 Kafka 群集Create a Kafka cluster with disk encryption

创建包含 Azure Data Lake Storage Gen2 的群集Create a cluster with Azure Data Lake Storage Gen2

使用 JSON 字符串中的配置创建群集Create a cluster with configuration from JSON string

使用本地文件中的配置创建群集Create a cluster with configuration from a local file

az hdinsight application createaz hdinsight application create

使用脚本 URI 创建应用程序Create an application with a script URI

使用脚本 URI 和指定边缘节点大小创建应用程序Create an application with a script URI and specified edge node size

使用 HTTPS 终结点创建应用程序Create an application with HTTPS Endpoint

az hdinsight script-action executeaz hdinsight script-action execute

执行脚本操作并在成功时继续Execute a script action and persist on success

此页面有帮助吗?

此页面有帮助吗?

Azure HDInsight：Azure CLI 示例Azure HDInsight: Azure CLI samples

先决条件Prerequisites

az loginaz login

az hdinsight createaz hdinsight create

使用现有存储帐户创建群集Create a cluster with an existing storage account

创建包含企业安全性套餐 (ESP) 的群集Create a cluster with the Enterprise Security Package (ESP)

创建具有磁盘加密功能的 Kafka 群集Create a Kafka cluster with disk encryption

创建包含 Azure Data Lake Storage Gen2 的群集Create a cluster with Azure Data Lake Storage Gen2

使用 JSON 字符串中的配置创建群集Create a cluster with configuration from JSON string

使用本地文件中的配置创建群集Create a cluster with configuration from a local file

az hdinsight application createaz hdinsight application create

使用脚本 URI 创建应用程序Create an application with a script URI

使用脚本 URI 和指定边缘节点大小创建应用程序Create an application with a script URI and specified edge node size

使用 HTTPS 终结点创建应用程序Create an application with HTTPS Endpoint

az hdinsight script-action executeaz hdinsight script-action execute

执行脚本操作并在成功时继续Execute a script action and persist on success

此页面有帮助吗?

此页面有帮助吗?