Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

16 releases of 1321

Last updated

  1. Environment variables for serverless jobs are in Beta

    Requires workspace admin to enable from Previews page.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Scala and Java UDFs in Unity Catalog are now generally available

    Reuses existing JVM logic, offers better performance than Python UDFs.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  3. Object metadata column is now in Public Preview

    Exposes object properties like MIME type and tags, available in Databricks Runtime 18.1.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  4. MySQL integrated CDC pipeline is now in Beta

    Replaces separate ingestion gateway, requires single pipeline update.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  5. Parquet v2 for Delta Lake tables is generally available

    Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  6. Comments on foreign tables (Beta)

    Syncs table and column comments from external data sources to Unity Catalog foreign tables.

    #Lakehouse Federation#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. OneLake catalog federation is generally available

    Allows reading OneLake data without copying, with read-only access and direct queries against file storage.

    #Lakehouse Federation#Unity Catalog
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  9. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  10. Auto time-to-live for automatic row deletion is generally available

    Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  11. Converting a partitioned table to liquid clustering is generally available

    Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  12. Lakehouse Replay (Beta)

    Automatically replays serverless workloads against upcoming runtime releases. Requires no setup.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  13. Spark Declarative Pipelines on Lakeflow updates are retained for 60 days

    Retention period increased from 30 to 60 days, applying to UI and REST API updates.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  14. SQL alert task for jobs (Beta)

    Evaluates SQL alerts as part of workflows, enabling automated condition checks and notifications.

    #Data Engineering#Data Warehousing
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  15. OneLake catalog federation (Beta)

    Allows read-only access to OneLake storage without copying data. Runs queries directly against file storage.

    #Lakehouse Federation#Unity Catalog
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  16. Delta Sharing on Lakehouse Federation is in Beta

    Shares foreign schemas and tables from query federation.

    #Delta Sharing#Lakehouse Federation
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  17. Salesforce Data Cloud File Sharing connector GA

    Replaces manual uploads, integrates with Lakehouse Federation.

    #Lakehouse Federation
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.