Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

23 releases of 1331

Last updated

  1. Environment variables for serverless jobs are in Beta

    Requires workspace admin to enable from Previews page.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Scala and Java UDFs in Unity Catalog are now generally available

    Reuses existing JVM logic, offers better performance than Python UDFs.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  3. Object metadata column is now in Public Preview

    Exposes object properties like MIME type and tags, available in Databricks Runtime 18.1.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  4. MySQL integrated CDC pipeline is now in Beta

    Replaces separate ingestion gateway, requires single pipeline update.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  5. Parquet v2 for Delta Lake tables is generally available

    Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  6. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Auto time-to-live for automatic row deletion is generally available

    Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  9. Converting a partitioned table to liquid clustering is generally available

    Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  10. Lakehouse Replay (Beta)

    Automatically replays serverless workloads against upcoming runtime releases. Requires no setup.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  11. Reorganized Spark Declarative Pipelines on Lakeflow documentation

    Conceptual topics are now under Concepts.

    #Documentation#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  12. Graviton instance types are available for the compliance security profile

    Graviton instances improve price-performance for many workloads on AWS Commercial workspaces with FedRAMP Moderate, IRAP, or CCCS Medium compliance standards.

    #Compliance#Security
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(not on this cloud)
  13. Spark Declarative Pipelines on Lakeflow updates are retained for 60 days

    Retention period increased from 30 to 60 days, applying to UI and REST API updates.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  14. C5, TISAX, and K-FSI compliance controls are now generally available

    Available on Azure, providing enhancements for workspace compliance requirements.

    #Compliance#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  15. Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon

    Deletes now retain associated tables by default, set cascade=true to remove them.

    #API#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  16. Databricks Documentation site table of contents tabs

    Replaces static sidebar with tabbed navigation, includes 6 context tabs.

    #Documentation
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  17. SQL alert task for jobs (Beta)

    Evaluates SQL alerts as part of workflows, enabling automated condition checks and notifications.

    #Data Engineering#Data Warehousing
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  18. ISMAP compliance support

    Supports Japanese government cloud certification, requires configuration changes.

    #Compliance#Security
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  19. Change to use_case field in VPC endpoint API responses Coming soon

    Changes from WORKSPACE_ACCESS to GENERAL_ACCESS, see API docs for details.

    #API
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Enhanced Security and Compliance add-on is now generally available

    includes compliance security profile and enhanced security monitoring.

    #Compliance#Security
    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  22. Expanded regional availability for C5 and TISAX compliance

    Now available in all regions and with serverless compute.

    #Compliance#Security
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  23. TISAX compliance controls (Public Preview)

    Enhances workspace compliance based on ISO/IEC 27001 and VDA ISA requirements.

    #Compliance#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  24. TISAX compliance controls

    Enhances workspace compliance based on ISO/IEC 27001 and VDA ISA.

    #Compliance#Security
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  25. Serverless compute resources now support PCI-DSS compliance in australia-east

    Supports PCI-DSS v4.0 in australia-east region.

    #Compliance
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)

Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.

We measure how the site is used. PostHog and Google Analytics, set to measurement only with advertising features off. We do not sell your data or share it for advertising, and you can turn this off. What this stores.