Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

29 releases of 1321

Last updated

  1. Data Classification now scans Unity Catalog views (Beta)

    Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.

    #Data Classification#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Private network gateway is in Private Preview

    Connects serverless compute to VPC and on-premises systems through a managed gateway, reusing existing network connectivity configuration.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  3. Cross-workspace access for serverless (Beta)

    Controls serverless network traffic between workspaces with ingress and egress rules.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. Environment variables for serverless jobs are in Beta

    Requires workspace admin to enable from Previews page.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  5. Context-based ingress control for workspaces public access is now generally available

    Uses allow and deny rules to control access based on identities, network sources, and request types.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  6. Scala and Java UDFs in Unity Catalog are now generally available

    Reuses existing JVM logic, offers better performance than Python UDFs.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Data Classification is now available by default for additional compliance standards

    Requires compliance security profile with C5, TISAX, or IRAP controls.

    #Data Classification#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  9. Allowlist partner platform IPs in context-based ingress control (Beta)

    Supports Power BI, Tableau Cloud, and dbt platform, with automatic IP list updates.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  10. Object metadata column is now in Public Preview

    Exposes object properties like MIME type and tags, available in Databricks Runtime 18.1.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  11. MySQL integrated CDC pipeline is now in Beta

    Replaces separate ingestion gateway, requires single pipeline update.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  12. Parquet v2 for Delta Lake tables is generally available

    Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  13. Block specific internet destinations in network policies (Public Preview)

    Blocks destinations regardless of network access mode, enforced through REST API.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  14. Data Classification is now available by default for some workspaces with the compliance security profile enabled

    Requires compliance security profile and specific controls like HIPAA or HITRUST.

    #Data Classification#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  15. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  16. Private Link for account-level resources (Beta)

    Connects account console through VPC interface endpoint instead of public internet. Requires configuration.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  17. Auto time-to-live for automatic row deletion is generally available

    Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  18. Converting a partitioned table to liquid clustering is generally available

    Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  19. Lakehouse Replay (Beta)

    Automatically replays serverless workloads against upcoming runtime releases. Requires no setup.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Inbound Private Link for performance-intensive services is now generally available

    Supports Lakebase Autoscaling and Zerobus Ingest.

    #Networking#Security
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  22. Connect Databricks to on-premises resources using an SSH reverse tunnel

    Uses proxy VMs in AWS, replacing inbound firewall access.

    #Networking#Security
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  23. Spark Declarative Pipelines on Lakeflow updates are retained for 60 days

    Retention period increased from 30 to 60 days, applying to UI and REST API updates.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  24. Databricks Data Classification is now GA

    Automatically classifies and tags sensitive data in Unity Catalog using AI.

    #Data Classification#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  25. SQL alert task for jobs (Beta)

    Evaluates SQL alerts as part of workflows, enabling automated condition checks and notifications.

    #Data Engineering#Data Warehousing
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  26. Inbound Private Link for performance-intensive services (Public Preview)

    Enables private connectivity for Zerobus Ingest and Lakebase Autoscaling.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  27. Serverless outbound IPs available through public JSON endpoint (Public Preview)

    Replaces existing stable IPs, requires Public Preview enrollment.

    #Networking#Security
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(unknown)
  28. Front-end PrivateLink for performance-intensive services (Beta)

    Supports private connectivity to Zerobus Ingest and Lakebase Autoscaling.

    #Networking#Security
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(unknown)
  29. Data Classification (Public Preview)

    Supports all catalog types, consolidates results into a system table.

    #Data Classification
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  30. Data classification system table Beta

    Captures sensitive data detections at column level across enabled catalogs.

    #Data Classification
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  31. PrivateLink connections from serverless compute to resources in your VPC through an NLB is generally available

    Uses an NLB, requires AWS PrivateLink configuration.

    #Networking
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.