Azure HDInsight 发行说明Azure HDInsight release notes

本文提供有关 最新 Azure HDInsight 版本更新的信息。This article provides information about the most recent Azure HDInsight release updates. 有关较早版本的信息,请参阅 HDInsight 发行说明存档For information on earlier releases, see HDInsight Release Notes Archive.

总结Summary

Azure HDInsight 是 Azure 中最受企业客户青睐的开源分析服务之一。Azure HDInsight is one of the most popular services among enterprise customers for open-source analytics on Azure.

如果要订阅发行说明,请查看此 GitHub 存储库上的版本。If you would like to subscribe on release notes, watch releases on this GitHub repository.

发布日期:2021/03/24Release date: 03/24/2021

此版本适用于 HDInsight 3.6 和 HDInsight 4.0。This release applies for both HDInsight 3.6 and HDInsight 4.0. HDInsight 发行版在几天后即会在所有区域中推出。HDInsight release is made available to all regions over several days. 此处的发行日期是指在第一个区域中的发行日期。The release date here indicates the first region release date. 如果看不到以下更改,请耐心等待,几天后发行版会在你所在的区域推出。If you don't see below changes, wait for the release being live in your region in several days.

新增功能New features

Spark 3.0 预览版Spark 3.0 preview

HDInsight 在 HDInsight 4.0 中添加了 Spark 3.0.0 支持作为预览功能。HDInsight added Spark 3.0.0 support to HDInsight 4.0 as a Preview feature.

Kafka 2.4 预览版Kafka 2.4 preview

HDInsight 在 HDInsight 4.0 中添加了 Kafka 2.4.1 支持作为预览功能。HDInsight added Kafka 2.4.1 support to HDInsight 4.0 as a Preview feature.

迁移到 Azure 虚拟机规模集Moving to Azure virtual machine scale sets

HDInsight 目前使用 Azure 虚拟机来预配群集。HDInsight now uses Azure virtual machines to provision the cluster. 此服务正在逐步迁移到 Azure 虚拟机规模集The service is gradually migrating to Azure virtual machine scale sets. 整个过程可能需要几个月。The entire process may take months. 迁移区域和订阅后,新创建的 HDInsight 群集将在虚拟机规模集上运行,而无需客户执行任何操作。After your regions and subscriptions are migrated, newly created HDInsight clusters will run on virtual machine scale sets without customer actions. 预计不会有中断性变更。No breaking change is expected.

弃用Deprecation

此版本没有任何弃用功能。No deprecation in this release.

行为更改Behavior changes

默认群集版本更改为 4.0Default cluster version is changed to 4.0

HDInsight 群集的默认版本从 3.6 更改为 4.0。The default version of HDInsight cluster is changed from 3.6 to 4.0. 有关可用版本的详细信息,请参阅可用版本For more information about available versions, see available versions. 详细了解 HDInsight 4.0 中的新增功能。Learn more about what is new in HDInsight 4.0.

默认的群集 VM 大小更改为 Ev3 系列Default cluster VM sizes are changed to Ev3-series

默认的群集 VM 大小从 D 系列更改为 Ev3 系列。Default cluster VM sizes are changed from D-series to Ev3-series. 此更改适用于头节点和工作器节点。This change applies to head nodes and worker nodes. 为避免此更改影响你已测试的工作流,请在 ARM 模板中指定要使用的 VM 大小。To avoid this change impacting your tested workflows, specify the VM sizes that you want to use in the ARM template.

对于在 Azure 虚拟机规模集上运行的群集,网络接口资源不可见Network interface resource not visible for clusters running on Azure virtual machine scale sets

HDInsight 正在逐步迁移到 Azure 虚拟机规模集。HDInsight is gradually migrating to Azure virtual machine scale sets. 对于使用 Azure 虚拟机规模集的群集的客户,虚拟机的网络接口不再可见。Network interfaces for virtual machines are no longer visible to customers for clusters that use Azure virtual machine scale sets.

即将推出的更改Upcoming changes

即将发布的版本中将推出以下变更。The following changes will happen in upcoming releases.

OS 版本升级OS version upgrade

HDInsight 会将 OS 版本从 Ubuntu 16.04 升级到 18.04。HDInsight will be upgrading OS version from Ubuntu 16.04 to 18.04. 此升级将在 2021 年 4 月之前完成。The upgrade will complete before April 2021.

从 2021 年 7 月 1 日开始为 HDInsight 3.6 提供基本支持Basic support for HDInsight 3.6 starting July 1, 2021

从 2021 年 7 月 1 日开始,Microsoft 将为某些 HDInsight 3.6 群集类型提供基本支持Starting July 1, 2021, Microsoft will offer Basic support for certain HDInsight 3.6 cluster types. 基本支持计划的可用日期截至 2022 年 4 月 3 日。The Basic support plan will be available until 3 April 2022. 从 2021 年 7 月 1 日开始,你将被自动加人基本支持。You'll automatically be enrolled in Basic support starting July 1, 2021. 无需执行任何操作即可选择加入。No action is required by you to opt in. 请参阅文档了解基本支持中包含哪些群集类型。See our documentation for which cluster types are included under Basic support.

不建议在 HDInsight 3.6 上构建任何新的解决方案,因为将在现有的 3.6 环境上冻结更改。We don't recommend building any new solutions on HDInsight 3.6, freeze changes on existing 3.6 environments. 建议将群集迁移到 HDInsight 4.0We recommend that you migrate your clusters to HDInsight 4.0. 详细了解 HDInsight 4.0 中的新增功能Learn more about what's new in HDInsight 4.0.

Bug 修复Bug fixes

HDInsight 会持续改善群集的可靠性和性能。HDInsight continues to make cluster reliability and performance improvements.

组件版本更改Component version change

添加了 Spark 3.0.0 和 Kafka 2.4.1 支持作为预览功能。Added support for Spark 3.0.0 and Kafka 2.4.1 as Preview. 可以在此文档中查找 HDInsight 4.0 和 HDInsight 3.6 的当前组件版本。You can find the current component versions for HDInsight 4.0 and HDInsight 3.6 in this doc.

推荐的功能Recommanded features

服务标记Service tags

服务标记可简化对 Azure 虚拟机和 Azure 虚拟网络的 Azure 服务的网络访问限制。Service tags simplify restricting network access to the Azure services for Azure virtual machines and Azure virtual networks. 网络安全组 (NSG) 中的服务标记规则可允许或拒绝特定 Azure 服务流量。Service tags in your network security group (NSG) rules allow or deny traffic to a specific Azure service. 可全局或按 Azure 区域设置此规则。The rule can be set globally or per Azure region. Azure 会对每个标记下面的 IP 地址进行维护。Azure provides the maintenance of IP addresses underlying each tag. 网络安全组 (NSG) 的 HDInsight 服务标记是运行状况和管理服务的 IP 地址组。HDInsight service tags for network security groups (NSGs) are groups of IP addresses for health and management services. 这些组有助于尽量降低创建安全规则时的复杂性。These groups help minimize complexity for security rule creation. HDInsight 客户可通过 Azure 门户、PowerShell 和 REST API 启用服务标记。HDInsight customers can enable service tag through Azure portal, PowerShell, and REST API. 有关详细信息,请参阅 Azure HDInsight 的网络安全组 (NSG) 服务标记For more information, see Network security group (NSG) service tags for Azure HDInsight.