Databricks releases, every cloud
- MLflow trace storage in Unity Catalog is now generally available
Stores traces in OpenTelemetry format with unlimited storage and SQL query access.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Scala and Java UDFs in Unity Catalog are now generally available
Reuses existing JVM logic, offers better performance than Python UDFs.
- AI Search High QPS is now generally available
Sets target QPS on standard endpoints for high-throughput workloads. Existing endpoints are not affected.
- REPLACE WHERE flows are now generally available
Replaces full table reprocessing with row-level updates based on a predicate.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Budgets are now generally available
Define spending thresholds with optional per-user overrides and actions like email alerts.
- Okta support for automatic identity management is now generally available
Lets you sync users and groups from Okta without SCIM provisioning.
AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP, read it on their docs - Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Lakeflow Connect row filtering is now generally available
Works like a SQL WHERE clause, applies to initial and incremental updates.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Parquet v2 for Delta Lake tables is generally available
Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.
- SQL alert task in Lakeflow Jobs is now generally available
Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state for downstream tasks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks connector for Power Platform is generally available
Connects Databricks to Power Platform services like Power BI and Power Apps. Requires Databricks account and Power Platform license.
- OneLake catalog federation is generally available
Allows reading OneLake data without copying, with read-only access and direct queries against file storage.
- Lakeflow Designer is now generally available
Offers no-code data transformation with drag-and-drop canvas and Unity Catalog governance. Coming soon to compliance workspaces.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - ai_query is now generally available
Lets you query AI models from SQL or Python.
- AUTO CDC flows for streaming tables in Databricks SQL are generally available
Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Auto time-to-live for automatic row deletion is generally available
Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.
- Converting a partitioned table to liquid clustering is generally available
Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.
- ai_classify is now generally available
Classifies text content according to custom labels with support for multi-label classification.
- ai_extract is now generally available
Extracts structured data from text and documents according to a provided schema. Supports nested objects and arrays.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Endpoint telemetry for custom model serving endpoints is generally available
Persists OpenTelemetry logs, traces, and metrics to Unity Catalog tables.
- The update_flow API for Spark Declarative Pipelines on Lakeflow is generally available
Writes to a sink in update output mode, emitting only changed rows. Supports stateful aggregations without a watermark.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - External lineage is now generally available
Registers external assets like Salesforce or MySQL sources and Tableau dashboards. Automatically records source lineage for Lakeflow Connect pipelines.
- Inbound Private Link for performance-intensive services is now generally available
Supports Lakebase Autoscaling and Zerobus Ingest.
- Foundation model Unity Catalog permissions is generally available
Requires account team enablement, controls access to system.ai schema.
- Query-based connectors for Lakeflow Connect are now generally available
Ingests data from databases like Oracle and PostgreSQL without CDC configuration.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Refresh policies and EXPLAIN CREATE MATERIALIZED VIEW for materialized views are now generally available
Requires Databricks Runtime 17.3 and above. Available in Databricks SQL.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Automatic identity management with Microsoft Entra ID is now GA
Replaces SCIM provisioning, syncs users and groups from Microsoft Entra ID.
AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP, read it on their docs - Databricks CLI is now GA
Stores U2M tokens in OS-native secure storage.
- Unity Catalog managed Apache Iceberg tables, foreign Apache Iceberg tables, and Apache Iceberg v3 features are generally available
Supports liquid clustering, predictive optimization, and materialized views. Requires Databricks Runtime or external Iceberg-compatible engines.
- Unified runs list is generally available
Replaces separate job and pipeline run lists, adds filtering and error code visualization.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Spark Declarative Pipelines on Lakeflow sinks are now generally available
Supports writing to Delta tables, Kafka topics, and Azure Event Hubs.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks SQL alerts are now generally available
Monitors data and KPIs by running scheduled queries, notifying recipients when conditions are met.
- Catalog commits are now generally available
Enables multi-statement transactions on Unity Catalog managed Delta tables, supported by products like MLflow and Delta Sharing.
- Databricks Runtime 18.2 is now GA
Replaces 7.3 and 7.3 ML.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Lakeflow Pipelines Editor is now generally available
Offers agent-first experience with Genie Code for creating production pipelines.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Disabling tasks in Lakeflow Jobs is now GA
Disabled tasks retain config and run history, can be re-enabled later.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Attribute-based access control (ABAC) is now generally available
Uses governed tags to enforce row filter and column mask policies. Replaces per-table configuration with automatic application at catalog, schema, or table level.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Workspace base environments are now generally available
Lets workspace admins create pre-built environments for serverless notebooks, enabled by default in compliance security profile workspaces.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks Data Classification is now GA
Automatically classifies and tags sensitive data in Unity Catalog using AI.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Altering a catalog or schema's managed storage location is now GA
Modifies default cloud storage location for new managed tables and volumes.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - ai_parse_document is now generally available
Parses structured content from unstructured documents, limited to 500 pages and 100 MB.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.