2020 年 10 月October 2020

这些功能和 Azure Databricks 平台的改进已于 2020 年 10 月发布。These features and Azure Databricks platform improvements were released in October 2020.

备注

发布分阶段进行。Releases are staged. 在初始发布日期后,可能最长需要等待一周,你的 Azure Databricks 帐户才会更新。Your Azure Databricks account may not be updated until up to a week after the initial release date.

联机 Power BI 服务中提供的新的 Azure Databricks Power BI 连接器(公共预览版)New Azure Databricks Power BI connector available in the online Power BI service (Public Preview)

2020 年 10 月 28 日October 28, 2020

9 月份在 Power BI Desktop 中发布的新的 Azure Databricks Power BI 连接器(公共预览版)现在也可在 Power BI 服务(也称为联机 Power BI)中使用了。The new Azure Databricks Power BI connector, released in Power BI Desktop in September (Public Preview), is now also available in the Power BI service (also known as Power BI online).

通过此原生连接器,你可以使用 Azure Active Directory 凭据从 Power BI Desktop 连接到 Azure Databricks,以及使用 SSO 连接到 Power BI 服务。The native connector lets you connect to Azure Databricks from Power BI Desktop using Azure Active Directory credentials and to the Power BI service using SSO. 此原生连接器支持 DirectQuery,允许你直接在 Azure Databricks 中访问数据,查询最新数据和实施数据湖安全控制。With support for DirectQuery, the native connector lets you access data directly in Azure Databricks, querying fresh data and enforcing data lake security controls. 如果你使用 Power BI 服务,则 SSO 可以确保所有报表用户都使用其自己的凭据访问 Azure Databricks - 无需在 Power BI 中重复进行安全控制。If you use the Power BI service, SSO ensures that all report users access Azure Databricks with their own credentials—no need to duplicate security controls in Power BI. 此连接器基于 Databricks ODBC 驱动程序,该驱动程序经过了优化,可以加快结果的传输。The connector is based on the Databricks ODBC driver, which has been optimized to speed up transfer of results.

有关详细信息,请参阅 Power BIFor more information, see Power BI.

Databricks Runtime 7.4(Beta 版本)Databricks Runtime 7.4 (Beta)

2020 年 10 月 21 日October 21, 2020

Databricks Runtime 7.4、Databricks Runtime 7.4 ML 和用于基因组学的 Databricks Runtime 7.4 现已作为 Beta 版本发布。Databricks Runtime 7.4, Databricks Runtime 7.4 ML, and Databricks Runtime 7.4 for Genomics are now available as Beta releases.

有关信息,请参阅 Databricks Runtime 7.4用于机器学习的 Databricks Runtime 7.4用于基因组学的 Databricks Runtime 7.4 提供的完整发行说明。For information, see the full release notes at Databricks Runtime 7.4, Databricks Runtime 7.4 for Machine Learning, and Databricks Runtime 7.4 for Genomics.

为 DBFS 根使用客户管理的密钥 (GA)Use customer-managed keys for DBFS root (GA)

2020 年 10 月 21 日October 21, 2020

现在,在 Azure Key Vault 中使用你自己的加密密钥来加密 DBFS 存储帐户的功能已正式发布。The ability to use your own encryption key in Azure Key Vault to encrypt the DBFS storage account is now generally available. 该功能需要 Azure Databricks Premium 计划This feature requires the Azure Databricks Premium Plan. 请参阅为 DBFS 根配置客户管理的密钥See Configure customer-managed keys for DBFS root.

扩展的试验访问控制 (ACL)Expanded experiment access control (ACLs)

2020 年 10 月 20-27 日:版本 3.31October 20-27, 2020: Version 3.31

现在已为所有部署启用随 Azure Databricks 平台版本 3.29(2020 年 9 月 23-29 日)引入的扩展试验权限The expanded experiment permissions introduced with Azure Databricks platform version 3.29 (Sept 23-29, 2020) are now enabled for all deployments.

有关详细信息,请参阅 MLflow 项目权限For more information, see MLflow Artifact permissions.

以高保真的形式导入和导出 Jupyter 笔记本 (ipynb) 文件High fidelity import and export of Jupyter notebook (ipynb) files

2020 年 10 月 20-27 日:版本 3.31October 20-27, 2020: Version 3.31

Azure Databricks 现在能够以 Jupyter 笔记本 (ipynb) 文件格式高保真地导入和导出笔记本。Azure Databricks now provides high fidelity import and export of notebooks to the Jupyter notebook (ipynb) file format. 导入最初从 Azure Databricks 导出的 Jupyter 笔记本文件时,会保留结果和仪表板。When you import Jupyter notebook files that were originally exported from Azure Databricks, results and dashboards are preserved. 以前只能通过 DBC 外部格式实现此操作。This was previously possible only with the DBC external format. 升级到 Jupyter 笔记本处理后,Azure Databricks 笔记本现在与 GitHub、nbformat、nbdime 和 nbconvert 等工具兼容。With this upgrade to Jupyter notebook handling, Azure Databricks notebooks are now compatible with tools like GitHub, nbformat, nbdime, and nbconvert. 请参阅笔记本外部格式See Notebook external formats.

SCIM API 改进:用户记录响应中既返回间接组,也返回直接组SCIM API improvement: both indirect and direct groups returned in user record response

2020 年 10 月 20-27 日:版本 3.31October 20-27, 2020: Version 3.31

SCIM API 返回的用户记录现在符合 SCIM RFC-7643 标准,因为响应列出了用户所属的组。User records returned by the SCIM API now comply with the SCIM RFC-7643 standard in the way that the response lists groups to which the user belongs. SCIM RFC-7643 定义了两种类型的组成员资格:直接和间接。SCIM RFC-7643 defines two types of group membership: direct and indirect. API 过去仅返回直接成员资格。The API was returning only direct membership. 它现在同时返回直接和间接成员资格。It now returns both direct and indirect membership. 它还包含一个新的 type 字段,用于区分这两者。It also includes a new type field to distinguish between the two. 请参阅 SCIM APISee SCIM API.

Azure 请求 ID 现包含在异常消息中Azure request ID is now included in exceptions

2020 年 10 月 20-27 日:版本 3.31October 20-27, 2020: Version 3.31

以下日志中现在包含有助于进行故障排除的 Azure 请求 ID (x-ms-client-request-id):The Azure request ID (x-ms-client-request-id) is now included in the following logs to aid in troubleshooting:

  • 群集事件Cluster events
  • Azure 引发异常时的服务日志Service logs when Azure throws exceptions
  • AzureLaunchException 的使用情况日志Usage logs of AzureLaunchException

Databricks Runtime 6.5 系列支持结束Databricks Runtime 6.5 series support ends

2020 年 10 月 14 日October 14, 2020

对 Databricks Runtime 6.5、用于机器学习的 Databricks Runtime 6.5 以及用于基因组学的 Databricks Runtime 6.5 的支持已于 10 月 14 日结束。Support for Databricks Runtime 6.5, Databricks Runtime 6.5 for Machine Learning, and Databricks Runtime 6.5 for Genomics ended on October 14. 请参阅 Databricks 运行时支持生命周期See Databricks runtime support lifecycle.

安全群集连接(无公共 IP)为公共预览版Secure cluster connectivity (no public IPs) is Public Preview

2020 年 10 月 13 日:版本 3.30October 13, 2020: Version 3.30

安全群集连接允许你启动所有节点都只有专用 IP 地址的群集,从而增强安全性。Secure cluster connectivity lets you launch clusters in which all nodes have only private IP addresses, providing enhanced security. 可以为新工作区启用安全群集连接。You can enable secure cluster connectivity for new workspaces. 如果你要迁移具有公共 IP 的工作区,则应创建允许进行安全群集连接的新工作区,并将资源迁移到新工作区。If you have workspaces with public IPs that you would like to migrate, you should create new workspaces enabled for secure cluster connectivity and migrate your resources to the new workspaces. 有关详细信息,请联系你的 Microsoft 或 Databricks 帐户团队。Contact your Microsoft or Databricks account team for details.

有关详细信息,请参阅安全群集连接For more information, see Secure cluster connectivity.

SCIM API 改进:$ref 字段响应SCIM API improvement: $ref field response

2020 年 10 月 7 日至 13 日:版本 3.30October 7-13, 2020: Version 3.30

在 SCIM 响应中,$ref 字段过去会在 URI 中返回一个内部主机名。In SCIM responses, the $ref field was returning an internal hostname in the URI. SCIM 响应现在会根据 SCIM RFC-7463 的规定在 $ref 字段中返回一个相对 URI。In accordance with SCIM RFC-7463, SCIM responses now return a relative URI in the $ref field.

诊断(审核)日志现在以低延迟方式提供Diagnostic (audit) logs are now delivered with low latency

2020 年 10 月 7 日至 13 日:版本 3.30October 7-13, 2020: Version 3.30

诊断审核日志现在以低延迟方式传送,在 Azure 商业区域中,可在 15 分钟内传送 99% 的日志。Diagnostic audit logs are now delivered with low latency, with 99% of logs delivered within 15 minutes in Azure Commercial regions. 无需执行任何操作即可实现低延迟传送。No action is necessary to enable low-latency delivery. 请参阅诊断日志传送See Diagnostic log delivery.

Databricks Runtime 7.3、7.3 ML 和 7.3 基因组学声明的长期支持 (LTS)Databricks Runtime 7.3, 7.3 ML, and 7.3 Genomics declared Long Term Support (LTS)

2020 年 10 月 8 日October 8, 2020

我们已声明 Databricks Runtime 7.3、用于机器学习的 Databricks Runtime 7.3 以及用于基因组学的 Databricks Runtime 7.3 为长期支持 (LTS) 版本。Databricks Runtime 7.3, Databricks Runtime 7.3 for Machine Learning, and Databricks Runtime 7.3 for Genomics have been declared Long Term Support (LTS) releases.

Azure Databricks 为 LTS 版本提供整整两年的支持。Azure Databricks provides two full years of support for LTS releases. 对这些版本的支持将持续至 2022 年 9 月 24 日。These releases will be supported until September 24, 2022.

有关这些 Databricks Runtime 版本的详细信息,请参阅 Databricks Runtime 7.3 LTS用于机器学习的 Databricks Runtime 7.3 LTS用于基因组学的 Databricks Runtime 7.3 LTS 的发行说明。For more information about these Databricks Runtime versions, see the Databricks Runtime 7.3 LTS, Databricks Runtime 7.3 LTS for Machine Learning, and Databricks Runtime 7.3 LTS for Genomics release notes.

使用 matplotlib 在更高的分辨率下呈现图像Render images at higher resolution using matplotlib

2020 年 10 月 7 日至 13 日:版本 3.30October 7-13, 2020: Version 3.30

现在可以在 Python 笔记本中以标准分辨率(也称为视网膜分辨率)两倍的分辨率呈现 matplotlib 图像,为高分辨率屏幕用户提供更好的可视化效果体验。You can now render matplotlib images in Python notebooks at double the standard resolution (also known as retina resolution), providing users of high-resolution screens with a better visualization experience. 请参阅以更高的分辨率呈现图像See Render images at higher resolution.

使用 Databricks CLI 或 Databricks API 创建由 Azure Key Vault 提供支持的机密范围Use the Databricks CLI or the Databricks API to create Azure Key Vault backed secret scopes

2020 年 10 月 7 日至 13 日:版本 3.30October 7-13, 2020: Version 3.30

现在可以使用 Databricks CLI 或 Databricks REST API 创建由 Azure Key Vault 提供支持的机密范围。You can now use the Databricks CLI or the Databricks REST API to create Azure Key Vault-backed secret scopes. 请参阅使用 Databricks CLI 创建 Azure Key Vault 支持的机密范围创建机密范围See Create an Azure Key Vault-backed secret scope using the Databricks CLI and Create secret scope.

使用 Azure AD 令牌向 Databricks CLI 进行身份验证Use Azure AD tokens to authenticate to the Databricks CLI

2020 年 10 月 7 日至 13 日:版本 3.30October 7-13, 2020: Version 3.30

现在可以使用 Azure Active Directory 令牌向 Databricks CLI 进行身份验证。You can now use Azure Active Directory tokens to authenticate to the Databricks CLI. 请参阅设置身份验证See Set up authentication.

新的 Azure 区域(公共预览版)New Azure regions (Public Preview)

2020 年 10 月 1 日October 1, 2020

Azure Databricks 目前在“中国东部 2”和“中国北部 2”区域以公共预览版形式提供。Azure Databricks is now available in the China East 2, and China North 2 regions as a Public Preview.