Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
January 24 - 31, 2023
These features and improvements were released with the 2023.03 release of Lakeflow Declarative Pipelines.
Databricks Runtime versions used by this release
Channel:
- CURRENT (default): Databricks Runtime 11.0.12
- PREVIEW: Databricks Runtime 11.3.3
New features and improvements in this release
You can now use files in a Databricks repo in your pipelines to import code from a source file stored in a repo. See Configure Lakeflow Declarative Pipelines.
You can now store your code as a Python package in an Azure Databricks repo and import that code in your Lakeflow Declarative Pipelines notebook.
The Lakeflow Declarative Pipelines UI is enhanced to include a label specifying the table type for each table in your pipeline DAG.
Bug fixes in this release
This release fixes a bug where the Permissions button was hidden during rendering of the Lakeflow Declarative Pipelines UI. With this change, the Permissions button is displayed but is disabled until the UI completes loading.
This release fixes a bug causing maintenance tasks to fail when Lakeflow Declarative Pipelines starts a new pipeline update while the maintenance task is running.
This release fixes an issue where applying a filter to a Lakeflow Declarative Pipelines view might lead to out-of-memory errors or long GC pauses.