Delta Live Tables release 2023.43

  • Article

October 30 - November 3, 2023

These features and improvements were released with the 2023.43 release of Delta Live Tables.

Note

Releases are staged. Your Delta Live Tables release, including Databricks Runtime versions, might not be updated until a week or more after the initial release date.

Databricks Runtime versions used by this release

Channel:

  • CURRENT (default): Databricks Runtime 12.2.15
  • PREVIEW: Databricks Runtime 13.3.4

New features and improvements in this release

  • When you view a pipeline in the Delta Live Tables UI, you can now view the pipeline datasets in a tabular view in addition to the graph visualization. You can use the tabular view for an overview of all datasets in the pipeline, particularly when the DAG is too large to fit in the graph view. You can also find specific datasets using filters such as dataset name and type. See What pipeline details are available in the UI?.

  • With this release, you will now see a warning message if you do not use the LIVE keyword when referencing a table in the same pipeline.

  • You can now write to a streaming table from multiple source streams, allowing you to add and remove streaming sources that append data to an existing streaming table without requiring a full refresh, or backfill a streaming table with missing historical data. See Use append flow to write to a streaming table from multiple source streams.

  • You can now add an allowlisted init script to the cluster that runs a Unity Catalog-enabled pipeline.