Databricks releases, every cloud
- Automatic change data feed is now generally available
Requires Databricks Runtime 19 or above with row tracking enabled. Makes MERGE and UPDATE operations about 15% faster.
- Consumer access to query Unity Gateway services will become generally available Coming soon
Requires account admins to set budgets and rate limits beforehand to control model traffic.
- Role-based access control (RBAC) is generally available
Requires account and workspace admin setup. Enables exclusive access to sensitive data.
- Databricks Runtime 19 and Databricks Runtime 19 for Machine Learning are now generally available
Powered by Apache Spark 4.2.0.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Email notifications for expiring service principal tokens are now generally available
Sends emails to workspace admins 7 days before token expiration for used tokens with lifetime over 7 days. No configuration is required.
- Context-based ingress control for workspaces public access is now generally available
Uses allow and deny rules to control access based on identities, network sources, and request types.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- AUTO CDC flows for streaming tables in Databricks SQL are generally available
Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Inbound Private Link for performance-intensive services is now generally available
Supports Lakebase Autoscaling and Zerobus Ingest.
- Refresh policies and EXPLAIN CREATE MATERIALIZED VIEW for materialized views are now generally available
Requires Databricks Runtime 17.3 and above. Available in Databricks SQL.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Automatic identity management with Microsoft Entra ID is now GA
Replaces SCIM provisioning, syncs users and groups from Microsoft Entra ID.
AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP, read it on their docs - Databricks SQL alerts are now generally available
Monitors data and KPIs by running scheduled queries, notifying recipients when conditions are met.
- Databricks Runtime 18.2 is now GA
Replaces 7.3 and 7.3 ML.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Scoped personal access tokens are now generally available
Restrict tokens to specific API operations with specified permissions. Coming soon to compliance security profile workspaces.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Customer-managed keys for Unity Catalog are generally available
Encrypts data in Unity Catalog catalogs using cloud KMS keys. Requires default storage.
- Databricks Runtime 18.1 is now GA
Replaces Databricks Runtime 7.3.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks Runtime 18.0 is now GA
Replaces Databricks Runtime 7.3.
- Databricks Runtime 17.3 LTS is now GA
Replaces 7.3 LTS, requires Databricks account.
- Databricks Runtime 17.2 is now is now GA
Replaces 7.3 and earlier, requires new cluster creation.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- New SQL editor is generally available
Provides a unified authoring environment with features like real-time collaboration and enhanced Databricks Assistant integration.
- Databricks Runtime 17.1 is now is now GA
Replaces Databricks Runtime 7.3.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.