Databricks releases, every cloud
- Serverless compute access control is now generally available
Governs access to notebooks, jobs, and pipelines through Default Interactive and Automated Compute objects. Existing workloads run unchanged.
- Scala and Java UDFs in Unity Catalog are now generally available
Reuses existing JVM logic, offers better performance than Python UDFs.
- Parquet v2 for Delta Lake tables is generally available
Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.
- AUTO CDC flows for streaming tables in Databricks SQL are generally available
Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Auto time-to-live for automatic row deletion is generally available
Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.
- Converting a partitioned table to liquid clustering is generally available
Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Compute log delivery to volumes is now GA
Delivers Spark driver, worker, and event logs to Unity Catalog volumes, recommended for log storage.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Serverless workspaces are now generally available
Come pre-configured with serverless compute and default storage.
- Flexible node types are now generally available
Falls back to alternative instance types when specified type is unavailable, improving launch reliability.
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.