Databricks releases, every cloud
- Python UDTFs in Unity Catalog are now generally available
Runs on serverless compute, classic compute, and SQL warehouses. Requires Databricks Runtime 18.
- Email notifications for expiring service principal tokens are now generally available
Sends emails to workspace admins 7 days before token expiration for used tokens with lifetime over 7 days. No configuration is required.
- Transactions are now generally available
Require catalog commits enabled on participating tables. Use BEGIN ATOMIC or BEGIN TRANSACTION syntax.
- Variant and Variant shredding are now generally available
Requires Databricks Runtime 17.3, recommended 18.1 for optimal performance.
- Context-based ingress control for workspaces public access is now generally available
Uses allow and deny rules to control access based on identities, network sources, and request types.
- Scala and Java UDFs in Unity Catalog are now generally available
Reuses existing JVM logic, offers better performance than Python UDFs.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- AI Search High QPS is now generally available
Sets target QPS on standard endpoints for high-throughput workloads. Existing endpoints are not affected.
- Budgets are now generally available
Define spending thresholds with optional per-user overrides and actions like email alerts.
- Okta support for automatic identity management is now generally available
Lets you sync users and groups from Okta without SCIM provisioning.
AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP, read it on their docs - Parquet v2 for Delta Lake tables is generally available
Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.
- ai_query is now generally available
Lets you query AI models from SQL or Python.
- Auto time-to-live for automatic row deletion is generally available
Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.
- Converting a partitioned table to liquid clustering is generally available
Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.
- ai_classify is now generally available
Classifies text content according to custom labels with support for multi-label classification.
- ai_extract is now generally available
Extracts structured data from text and documents according to a provided schema. Supports nested objects and arrays.
- Endpoint telemetry for custom model serving endpoints is generally available
Persists OpenTelemetry logs, traces, and metrics to Unity Catalog tables.
- External lineage is now generally available
Registers external assets like Salesforce or MySQL sources and Tableau dashboards. Automatically records source lineage for Lakeflow Connect pipelines.
- Inbound Private Link for performance-intensive services is now generally available
Supports Lakebase Autoscaling and Zerobus Ingest.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Foundation model Unity Catalog permissions is generally available
Requires account team enablement, controls access to system.ai schema.
- Automatic identity management with Microsoft Entra ID is now GA
Replaces SCIM provisioning, syncs users and groups from Microsoft Entra ID.
AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP, read it on their docs - Databricks CLI is now GA
Stores U2M tokens in OS-native secure storage.
- Unity Catalog managed Apache Iceberg tables, foreign Apache Iceberg tables, and Apache Iceberg v3 features are generally available
Supports liquid clustering, predictive optimization, and materialized views. Requires Databricks Runtime or external Iceberg-compatible engines.
- Databricks SQL alerts are now generally available
Monitors data and KPIs by running scheduled queries, notifying recipients when conditions are met.
- Catalog commits are now generally available
Enables multi-statement transactions on Unity Catalog managed Delta tables, supported by products like MLflow and Delta Sharing.
- Governed tags are generally available
Allow administrators to define controlled tags for Unity Catalog and workspace objects, enforcing consistent metadata tagging.
- SAP Databricks usage dashboard is now generally available
Account admins can import pre-built dashboards to monitor usage at account and workspace levels.
- Lakebase is now generally available with compliance security profile
Requires HIPAA, C5, TISAX, or None compliance standard.
AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP, read it on their docs - Lakebase is now generally available on Azure
Adds autoscaling compute and scale-to-zero to 11 new Azure regions.
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.