Skip to content

Databricks releases, every cloud

27 releases of 1321

Last updated

  1. Base environments are now supported on classic compute (Beta)

    Manages Python dependencies using Databricks-provided or custom environments.

  2. Git Folder Serverless is in Beta

    Shares serverless compute and pyproject.toml environment across notebooks and files.

  3. Default Python package repositories are GA for Lakeflow pipelines and classic compute

    Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.

  4. Manage project environments with %uv commands

    Requires environment version 5 or above. Supports serverless notebooks.

  5. Target an Azure capacity reservation group for classic compute

    Requires VNet injection, guarantees compute capacity for constrained VM types.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  6. Environment variables for serverless jobs are in Beta

    Requires workspace admin to enable from Previews page.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Serverless compute access control is now generally available

    Governs access to notebooks, jobs, and pipelines through Default Interactive and Automated Compute objects. Existing workloads run unchanged.

  9. Web terminal on serverless GPU compute (AI Runtime) is in Public Preview

    Runs shell commands, monitors GPU usage, and manages files on serverless GPU compute. Requires environment version 5 or above.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  10. Dedicated group clusters will soon be available by default for workspaces with the compliance security profile enabled Coming soon

    Enables shared compute for groups with compliance security profile, supporting Databricks Runtime for ML and RDD APIs.

  11. Scala and Java UDFs in Unity Catalog are now generally available

    Reuses existing JVM logic, offers better performance than Python UDFs.

  12. Serverless compute is now available in the Azure UK West region

    Supports notebooks, jobs, pipelines, and SQL warehouses, with private connectivity.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP, read it on their docs
  13. Object metadata column is now in Public Preview

    Exposes object properties like MIME type and tags, available in Databricks Runtime 18.1.

  14. MySQL integrated CDC pipeline is now in Beta

    Replaces separate ingestion gateway, requires single pipeline update.

  15. Parquet v2 for Delta Lake tables is generally available

    Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.

  16. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

  17. Auto time-to-live for automatic row deletion is generally available

    Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.

  18. Converting a partitioned table to liquid clustering is generally available

    Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.

  19. Lakehouse Replay (Beta)

    Automatically replays serverless workloads against upcoming runtime releases. Requires no setup.

  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Schedule deferred policy enforcement for all-purpose compute

    Applies on next restart or immediately, and admins can cancel scheduled enforcements.

  22. Instance events and instance pools system tables are now available (Public Preview)

    Track instance state transitions and instance pool configurations via system.compute.instance_events and system.compute.instance_pools tables.

  23. Databricks Container Services for standard compute is now available (Beta)

    Requires Databricks Runtime 18.3 or later, allows custom Docker images in shared compute.

  24. Spark Declarative Pipelines on Lakeflow updates are retained for 60 days

    Retention period increased from 30 to 60 days, applying to UI and REST API updates.

  25. Compute log delivery to volumes is now GA

    Delivers Spark driver, worker, and event logs to Unity Catalog volumes, recommended for log storage.

  26. SQL alert task for jobs (Beta)

    Evaluates SQL alerts as part of workflows, enabling automated condition checks and notifications.

  27. Serverless compute is enabled by default

    Eligible Google Cloud workspaces are affected, account admins no longer need to manually enable it.

    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  28. Flexible node types are now generally available

    Falls back to alternative instance types when specified type is unavailable, improving launch reliability.

  29. Configure compute to use AWS Capacity Blocks

    Replaces on-demand instances, requires AWS account setup.

    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.