Databricks releases, every cloud
- JAR tasks on serverless compute are now generally available
Requires matching Scala, Java Development Kit, and Databricks Connect versions.
- Serverless compute access control is now generally available
Governs access to notebooks, jobs, and pipelines through Default Interactive and Automated Compute objects. Existing workloads run unchanged.
- Email notifications for expiring service principal tokens are now generally available
Sends emails to workspace admins 7 days before token expiration for used tokens with lifetime over 7 days. No configuration is required.
- Scala and Java UDFs in Unity Catalog are now generally available
Reuses existing JVM logic, offers better performance than Python UDFs.
- Parquet v2 for Delta Lake tables is generally available
Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.
- AUTO CDC flows for streaming tables in Databricks SQL are generally available
Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Auto time-to-live for automatic row deletion is generally available
Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.
- Converting a partitioned table to liquid clustering is generally available
Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.
- Workspace base environments are now generally available
Lets workspace admins create pre-built environments for serverless notebooks, enabled by default in compliance security profile workspaces.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Serverless workspaces are now generally available
Come pre-configured with serverless compute and default storage.
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.