Delta Live Tables release 2023.41
September 16 - October 20, 2023
These features and improvements were released with the 2023.41 release of Delta Live Tables.
Note
Releases are staged. Your Delta Live Tables release, including Databricks Runtime versions, might not be updated until a week or more after the initial release date.
Databricks Runtime versions used by this release
Channel:
- CURRENT (default): Databricks Runtime 12.2.14
- PREVIEW: Databricks Runtime 13.3.3
New features and improvements in this release
You can now add custom monitoring and alerting to your Delta Live Tables pipelines using event hooks (Public Preview). For example, using event hooks you can send emails or integrate with third-party monitoring solutions to send alerts when selected events occur.
This release improves the detection and error messaging for circular dependencies in a pipeline. For example, when a downstream table is referenced to create an upstream table.
Bug fixes in this release
This release fixes an issue causing a pipeline to fail when an SCD type 1 query with expectations enabled has a case mismatch in column names.
With this release, cluster policy default values are correctly applied when the
apply_policy_default_values
setting is set totrue
in the pipeline configuration. Previously, in some cases, cluster policy defaults were not correctly applied. See Select a cluster policy.