Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

11 releases of 1321

Last updated

  1. Serverless compute access control is now generally available

    Governs access to notebooks, jobs, and pipelines through Default Interactive and Automated Compute objects. Existing workloads run unchanged.

    #Compute#Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Scala and Java UDFs in Unity Catalog are now generally available

    Reuses existing JVM logic, offers better performance than Python UDFs.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  3. Parquet v2 for Delta Lake tables is generally available

    Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  4. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  5. Auto time-to-live for automatic row deletion is generally available

    Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  6. Converting a partitioned table to liquid clustering is generally available

    Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Refresh policies and EXPLAIN CREATE MATERIALIZED VIEW for materialized views are now generally available

    Requires Databricks Runtime 17.3 and above. Available in Databricks SQL.

    #Databricks SQL#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  9. Databricks SQL alerts are now generally available

    Monitors data and KPIs by running scheduled queries, notifying recipients when conditions are met.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  10. Compute log delivery to volumes is now GA

    Delivers Spark driver, worker, and event logs to Unity Catalog volumes, recommended for log storage.

    #Compute
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  11. Flexible node types are now generally available

    Falls back to alternative instance types when specified type is unavailable, improving launch reliability.

    #Compute
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  12. New SQL editor is generally available

    Provides a unified authoring environment with features like real-time collaboration and enhanced Databricks Assistant integration.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.