Databricks releases, every cloud
- Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon
Replaces full snapshot default, improving performance and reducing cost.
- Apache Arrow support for Zerobus Ingest is now generally available
Replaces JSON and Avro formats, requires Lakeflow Connect.
- ABAC GRANT policies are generally available for models and services
Replaces individual privilege grants with governed tag matching.
- Zerobus Ingest into streaming tables is now generally available
Works like writing to a managed Delta table with same limits and quotas.
- Salesforce connector mTLS authentication is now generally available
Replaces OAuth client credentials flow for API-only users, requires client certificates.
- Role-based access control (RBAC) is generally available
Requires account and workspace admin setup. Enables exclusive access to sensitive data.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- JAR tasks on serverless compute are now generally available
Requires matching Scala, Java Development Kit, and Databricks Connect versions.
- Schema-level HTTP connections in Unity Catalog are now generally available
Creates connections inside a schema, inheriting its privileges, instead of only at metastore level.
- Python UDTFs in Unity Catalog are now generally available
Runs on serverless compute, classic compute, and SQL warehouses. Requires Databricks Runtime 18.
- MLflow trace storage in Unity Catalog is now generally available
Stores traces in OpenTelemetry format with unlimited storage and SQL query access.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - REPLACE WHERE flows are now generally available
Replaces full table reprocessing with row-level updates based on a predicate.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Lakeflow Connect row filtering is now generally available
Works like a SQL WHERE clause, applies to initial and incremental updates.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - SQL alert task in Lakeflow Jobs is now generally available
Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state for downstream tasks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - OneLake catalog federation is generally available
Allows reading OneLake data without copying, with read-only access and direct queries against file storage.
- The update_flow API for Spark Declarative Pipelines on Lakeflow is generally available
Writes to a sink in update output mode, emitting only changed rows. Supports stateful aggregations without a watermark.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - External lineage is now generally available
Registers external assets like Salesforce or MySQL sources and Tableau dashboards. Automatically records source lineage for Lakeflow Connect pipelines.
- Query-based connectors for Lakeflow Connect are now generally available
Ingests data from databases like Oracle and PostgreSQL without CDC configuration.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Refresh policies and EXPLAIN CREATE MATERIALIZED VIEW for materialized views are now generally available
Requires Databricks Runtime 17.3 and above. Available in Databricks SQL.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Unity Catalog managed Apache Iceberg tables, foreign Apache Iceberg tables, and Apache Iceberg v3 features are generally available
Supports liquid clustering, predictive optimization, and materialized views. Requires Databricks Runtime or external Iceberg-compatible engines.
- Unified runs list is generally available
Replaces separate job and pipeline run lists, adds filtering and error code visualization.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Spark Declarative Pipelines on Lakeflow sinks are now generally available
Supports writing to Delta tables, Kafka topics, and Azure Event Hubs.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Catalog commits are now generally available
Enables multi-statement transactions on Unity Catalog managed Delta tables, supported by products like MLflow and Delta Sharing.
- Lakeflow Pipelines Editor is now generally available
Offers agent-first experience with Genie Code for creating production pipelines.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Disabling tasks in Lakeflow Jobs is now GA
Disabled tasks retain config and run history, can be re-enabled later.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Attribute-based access control (ABAC) is now generally available
Uses governed tags to enforce row filter and column mask policies. Replaces per-table configuration with automatic application at catalog, schema, or table level.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks Data Classification is now GA
Automatically classifies and tags sensitive data in Unity Catalog using AI.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Altering a catalog or schema's managed storage location is now GA
Modifies default cloud storage location for new managed tables and volumes.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Governed tags are generally available
Allow administrators to define controlled tags for Unity Catalog and workspace objects, enforcing consistent metadata tagging.
- Customer-managed keys for Unity Catalog are generally available
Encrypts data in Unity Catalog catalogs using cloud KMS keys. Requires default storage.
- COMMENT ON streaming tables is now GA
Adds comments to streaming tables, previously only available for non-streaming tables.
- Applying filters, masks, tags, and comments to pipeline-created datasets is now GA
Modifies ETL and ingestion pipelines using CREATE, ALTER, or Lakeflow UI. Applies to Spark Declarative Pipelines on Lakeflow and Lakeflow Connect.
- Updated Lakeflow Jobs UI is generally available
Simplifies job creation and editing, see Lakeflow Jobs for details.
- Spark Declarative Pipelines on Lakeflow stream progress metrics are generally available
Supports querying event log for stream progress metrics.
- Migrate Spark Declarative Pipelines on Lakeflow pipelines from legacy publishing mode is generally available
Replaces legacy mode that only published to a single catalog and schema. Now supports multiple catalogs and schemas.
- Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is now GA
Replaces legacy single-catalog publishing with multi-catalog support.
- Moving tables between Spark Declarative Pipelines on Lakeflow pipelines is now GA
Supports moving tables in Unity Catalog ETL pipelines.
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.