Skip to content

Databricks releases, every cloud

26 releases of 1348

Last updated

  1. Data Classification now scans Unity Catalog views (Beta)

    Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.

  2. Custom trace views in the MLflow trace explorer are in Beta

    Genie generates views based on plain language descriptions, surfacing relevant trace fields and metrics.

  3. Environment variables for serverless jobs are in Beta

    Requires workspace admin to enable from Previews page.

  4. MLflow trace storage in Unity Catalog is now generally available

    Stores traces in OpenTelemetry format with unlimited storage and SQL query access.

  5. Scala and Java UDFs in Unity Catalog are now generally available

    Reuses existing JVM logic, offers better performance than Python UDFs.

  6. Data Classification is now available by default for additional compliance standards

    Requires compliance security profile with C5, TISAX, or IRAP controls.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Object metadata column is now in Public Preview

    Exposes object properties like MIME type and tags, available in Databricks Runtime 18.1.

  9. MySQL integrated CDC pipeline is now in Beta

    Replaces separate ingestion gateway, requires single pipeline update.

  10. Parquet v2 for Delta Lake tables is generally available

    Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.

  11. Data Classification is now available by default for some workspaces with the compliance security profile enabled

    Requires compliance security profile and specific controls like HIPAA or HITRUST.

  12. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

  13. Auto time-to-live for automatic row deletion is generally available

    Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.

  14. Converting a partitioned table to liquid clustering is generally available

    Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.

  15. Lakehouse Replay (Beta)

    Automatically replays serverless workloads against upcoming runtime releases. Requires no setup.

  16. Reorganized Spark Declarative Pipelines on Lakeflow documentation

    Conceptual topics are now under Concepts.

  17. Customer-managed keys now support MLflow managed evaluation features

    Supports MLflow 3 scorers and requires non-CMK encrypted catalog.

  18. MLflow trace storage in Unity Catalog is now in Public Preview

    Stores OpenTelemetry traces, governed by Unity Catalog permissions, queryable from Databricks SQL or MLflow Python SDK.

  19. Spark Declarative Pipelines on Lakeflow updates are retained for 60 days

    Retention period increased from 30 to 60 days, applying to UI and REST API updates.

  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Databricks Data Classification is now GA

    Automatically classifies and tags sensitive data in Unity Catalog using AI.

  22. Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon

    Deletes now retain associated tables by default, set cascade=true to remove them.

  23. Databricks Documentation site table of contents tabs

    Replaces static sidebar with tabbed navigation, includes 6 context tabs.

    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  24. SQL alert task for jobs (Beta)

    Evaluates SQL alerts as part of workflows, enabling automated condition checks and notifications.

  25. Change to use_case field in VPC endpoint API responses Coming soon

    Changes from WORKSPACE_ACCESS to GENERAL_ACCESS, see API docs for details.

    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  26. Store and query MLflow traces in Unity Catalog (Beta)

    Stores MLflow traces in Delta tables for long-term retention and analysis using OpenTelemetry format.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  27. Data Classification (Public Preview)

    Supports all catalog types, consolidates results into a system table.

  28. Data classification system table Beta

    Captures sensitive data detections at column level across enabled catalogs.

Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.

We measure how the site is used. PostHog and Google Analytics, set to measurement only with advertising features off. We do not sell your data or share it for advertising, and you can turn this off. What this stores.