February 2023
These features and Azure Databricks platform improvements were released in February 2023.
Note
The release date and content listed below only corresponds to actual deployment of the Azure Public Cloud in most case.
It provide the evolution history of Azure Databricks service on Azure Public Cloud for your reference that may not be suitable for Azure operated by 21Vianet.
Note
Releases are staged. Your Azure Databricks account might not be updated until a week or more after the initial release date.
February 24, 2023
With Databricks Runtime 12.0 and above, you can create a Ray cluster and run Ray applications in Azure Databricks with the Ray on Spark API. See What is Ray on Azure Databricks?.
February 23, 2023
When you execute a cell in a notebook, the lesser of 10,000 rows or 2 MB of output is displayed.
February 22, 2023
You can ensure there is always an active run of your Azure Databricks job with the new continuous
trigger type. See Run jobs continuously.
February 22, 2023
You can now use a file arrival trigger to run your Azure Databricks job when new files arrive in an external location such as Amazon S3 or Azure storage. See Trigger jobs when new files arrive.
February 21, 2023
Version 1.10.0 makes updates to databricks_share
, various documentation updates, and more. For more details, see the changelog for version 1.10.0.
February 21, 2023
Starting February 21, 2023, legacy global init scripts and cluster-named init scripts are disabled and cannot be used in new workspaces. See What are init scripts?.
February 17, 2023
The MLflow experiment UI now includes a configurable chart view providing visual model performance insights, a revamped parallel coordinates experience for tuning, and a streamlined table view with enhancements for search and filtering. See Organize training runs with MLflow experiments.
February 17, 2023
Databricks Runtime 12.2 and Databricks Runtime 12.2 ML are now available as Beta releases.
See Databricks Runtime 12.2 LTS and Databricks Runtime 12.2 LTS for Machine Learning.
February 15, 2023
You can now use user-assigned managed identities instead of system-assigned managed identities to access storage containers on behalf of Unity Catalog users. See Use Azure managed identities in Unity Catalog to access storage.
February 14, 2023
The Databricks extension for Visual Studio Code lets developers leverage the powerful authoring capabilities of IDEs while connecting to Azure Databricks clusters to run code remotely, employing best practices such as source control, modularized code, refactoring, and unit testing.
February 3, 2023
Version 1.9.2 adds a databricks_node_type
selector, a new file library type for databricks_pipeline
, various documentation updates, and more. For more details, see the changelog for version 1.9.2.
February 3, 2023
Some Azure Databricks services and data support adding a customer-managed key to help protect and control access to encrypted data. Azure Databricks has three customer-managed key features that involve different types of data and locations, which you can compare in Customer-managed keys for encryption. All three of these features are now generally available.
February 1, 2023
With Databricks Runtime 12.1 and above, you can now directly observe current Python variables and their values in the notebook UI.