Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

56 releases of 1321

Last updated

  1. Base environments are now supported on classic compute (Beta)

    Manages Python dependencies using Databricks-provided or custom environments.

    #Compute#Notebooks
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Private network gateway is in Beta

    Connects serverless compute to VNet and on-premises systems through a managed gateway. Enabled from account console Previews page.

    #Networking#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  3. Git Folder Serverless is in Beta

    Shares serverless compute and pyproject.toml environment across notebooks and files.

    #Compute#Git Folders
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. Private network gateway is in Private Preview

    Connects serverless compute to VPC and on-premises systems through a managed gateway, reusing existing network connectivity configuration.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  5. Inbound Private Service Connect for performance-intensive services (Beta)

    Enables private connectivity to services like Zerobus Ingest and Lakebase Autoscaling on Google Cloud.

    #Networking#Security
    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  6. Default Python package repositories are GA for Lakeflow pipelines and classic compute

    Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.

    #Compute#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Manage project environments with %uv commands

    Requires environment version 5 or above. Supports serverless notebooks.

    #Compute#Notebooks
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Cross-workspace access for serverless (Beta)

    Controls serverless network traffic between workspaces with ingress and egress rules.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. Custom URL access to workspaces over inbound Private Link (Beta)

    Uses general_access private endpoint, serves workspaces and account-level resources across regions.

    #Networking#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  11. Target an Azure capacity reservation group for classic compute

    Requires VNet injection, guarantees compute capacity for constrained VM types.

    #Compute
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  12. Serverless outbound Private Service Connect to customer-managed resources (Public Preview)

    Keeps traffic off the public internet, adding network-layer defense against data exfiltration through customer-managed Google Cloud service attachment.

    #Networking#Security
    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  13. Environment variables for serverless jobs are in Beta

    Requires workspace admin to enable from Previews page.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  14. Serverless compute access control is now generally available

    Governs access to notebooks, jobs, and pipelines through Default Interactive and Automated Compute objects. Existing workloads run unchanged.

    #Compute#Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  15. Web terminal on serverless GPU compute (AI Runtime) is in Public Preview

    Runs shell commands, monitors GPU usage, and manages files on serverless GPU compute. Requires environment version 5 or above.

    #Compute#Machine Learning
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  16. Dedicated group clusters will soon be available by default for workspaces with the compliance security profile enabled Coming soon

    Enables shared compute for groups with compliance security profile, supporting Databricks Runtime for ML and RDD APIs.

    #Compute#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  17. Networking charges for performance-intensive products

    Charges apply to cross-region and public-internet egress for Lakebase, OpenSharing SecureConnect, Zerobus, and Files API.

    #Billing#Networking
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP, read it on their docs
  18. Context-based ingress control for workspaces public access is now generally available

    Uses allow and deny rules to control access based on identities, network sources, and request types.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  19. Scala and Java UDFs in Unity Catalog are now generally available

    Reuses existing JVM logic, offers better performance than Python UDFs.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Allowlist partner platform IPs in context-based ingress control (Beta)

    Supports Power BI, Tableau Cloud, and dbt platform, with automatic IP list updates.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  22. Serverless compute is now available in the Azure UK West region

    Supports notebooks, jobs, pipelines, and SQL warehouses, with private connectivity.

    #Compute#Networking
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP, read it on their docs
  23. Object metadata column is now in Public Preview

    Exposes object properties like MIME type and tags, available in Databricks Runtime 18.1.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  24. MySQL integrated CDC pipeline is now in Beta

    Replaces separate ingestion gateway, requires single pipeline update.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  25. Parquet v2 for Delta Lake tables is generally available

    Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  26. Block specific internet destinations in network policies (Public Preview)

    Blocks destinations regardless of network access mode, enforced through REST API.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  27. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  28. Private Link for account-level resources (Beta)

    Connects account console through VPC interface endpoint instead of public internet. Requires configuration.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  29. Auto time-to-live for automatic row deletion is generally available

    Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  30. Converting a partitioned table to liquid clustering is generally available

    Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  31. Lakehouse Replay (Beta)

    Automatically replays serverless workloads against upcoming runtime releases. Requires no setup.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  32. Schedule deferred policy enforcement for all-purpose compute

    Applies on next restart or immediately, and admins can cancel scheduled enforcements.

    #Compute
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  33. Inbound Private Link for performance-intensive services is now generally available

    Supports Lakebase Autoscaling and Zerobus Ingest.

    #Networking#Security
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  34. Intra-VNet NSG rule hardening for Azure Databricks is now in Public Preview

    Restricts workspace traffic to host and worker subnet CIDRs. Applies to classic compute plane workspaces.

    #Networking#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  35. Instance events and instance pools system tables are now available (Public Preview)

    Track instance state transitions and instance pool configurations via system.compute.instance_events and system.compute.instance_pools tables.

    #Compute#Platform
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  36. Databricks Container Services for standard compute is now available (Beta)

    Requires Databricks Runtime 18.3 or later, allows custom Docker images in shared compute.

    #Compute
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  37. Azure UK South now has a dedicated regional control plane

    New workspaces require firewall allowlist entries for SCC relay tunnel and other IPs. Existing workspaces use UK West control plane unless migrated.

    #Networking#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP, read it on their docs
  38. Connect Azure Databricks to on-premises resources using an SSH reverse tunnel

    Replaces inbound firewall access, works with classic and serverless compute.

    #Networking#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  39. Connect Databricks to on-premises resources using an SSH reverse tunnel

    Uses proxy VMs in AWS, replacing inbound firewall access.

    #Networking#Security
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  40. Spark Declarative Pipelines on Lakeflow updates are retained for 60 days

    Retention period increased from 30 to 60 days, applying to UI and REST API updates.

    #Data Engineering
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  41. Compute log delivery to volumes is now GA

    Delivers Spark driver, worker, and event logs to Unity Catalog volumes, recommended for log storage.

    #Compute
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  42. SQL alert task for jobs (Beta)

    Evaluates SQL alerts as part of workflows, enabling automated condition checks and notifications.

    #Data Engineering#Data Warehousing
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.