Skip to content

Databricks releases, every cloud

91 releases of 1321

Last updated

  1. Data Classification is now available by default for some workspaces with the compliance security profile enabled

    Requires compliance security profile and specific controls like HIPAA or HITRUST.

  2. Enable access requests across your Unity Catalog metastore (Public Preview)

    Enables requests at metastore level, inherited by all catalogs and schemas.

  3. The Discover page is now in Public Preview

    Helps find Unity Catalog data assets without requiring catalog hierarchy knowledge. Organizes tables and dashboards by business area.

  4. Comments on foreign tables (Beta)

    Syncs table and column comments from external data sources to Unity Catalog foreign tables.

  5. OneLake catalog federation is generally available

    Allows reading OneLake data without copying, with read-only access and direct queries against file storage.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  6. Configure the recovery period for dropped managed tables (Public Preview)

    Sets recovery period to 0 hours or 7-30 days, requires Databricks Runtime 17.3.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Databricks-to-Databricks Delta Sharing across regulatory domains is now available (Public Preview)

    Supports sharing with AWS GovCloud, AWS GovCloud DoD, and Azure China.

  9. AI Runtime CLI (Beta)

    Submits and manages distributed training workloads on serverless GPU compute from a local machine.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  10. ABAC GRANT policies for models (Beta)

    Grants EXECUTE privilege on models based on governed tags, supporting MLflow and foundation models.

  11. External lineage is now generally available

    Registers external assets like Salesforce or MySQL sources and Tableau dashboards. Automatically records source lineage for Lakeflow Connect pipelines.

  12. Column popularity is now available in the Catalog Explorer

    Shows column query count in the Overview tab, determined by read queries.

  13. Cross-engine attribute-based access controls (Beta)

    Enforces row filters and column masks server-side for external engines reading Unity Catalog tables.

  14. Unity Catalog managed Apache Iceberg tables, foreign Apache Iceberg tables, and Apache Iceberg v3 features are generally available

    Supports liquid clustering, predictive optimization, and materialized views. Requires Databricks Runtime or external Iceberg-compatible engines.

  15. Serve custom LLMs with Custom Model Serving (Beta)

    Supports multimodal models and PEFT recipes, unlike Foundation Model APIs.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  16. Catalog commits are now generally available

    Enables multi-statement transactions on Unity Catalog managed Delta tables, supported by products like MLflow and Delta Sharing.

  17. MLflow trace storage in Unity Catalog is now in Public Preview

    Stores OpenTelemetry traces, governed by Unity Catalog permissions, queryable from Databricks SQL or MLflow Python SDK.

  18. Attribute-based access control (ABAC) is now generally available

    Uses governed tags to enforce row filter and column mask policies. Replaces per-table configuration with automatic application at catalog, schema, or table level.

  19. Tag Unity Catalog functions

    Requires Databricks Runtime 18.1 or above. Uses SET TAG and UNSET TAG commands.

  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Recently Resolved Incidents section in Data Quality Monitoring (Beta)

    Shows automatically recovered unhealthy tables, including resolution time.

  22. Language selector for AI-generated comments in Catalog Explorer

    Saves selection in browser's local storage, applying to all entity types.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  23. AI Runtime 1xH100 accelerator (Beta)

    Supports 1xH100 accelerator, see Hardware options for details.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  24. Databricks Data Classification is now GA

    Automatically classifies and tags sensitive data in Unity Catalog using AI.

  25. Altering a catalog or schema's managed storage location is now GA

    Modifies default cloud storage location for new managed tables and volumes.

  26. Create and write to Unity Catalog tables from external Delta clients (Beta)

    Requires catalog-managed commits to be enabled, supports Apache Spark clients.

  27. SQL reference documentation for managing governed tags

    Adds 5 SQL statements: CREATE, ALTER, DROP, DESCRIBE, SHOW.

  28. Governed tags are generally available

    Allow administrators to define controlled tags for Unity Catalog and workspace objects, enforcing consistent metadata tagging.

  29. Customer-managed keys for Unity Catalog are generally available

    Encrypts data in Unity Catalog catalogs using cloud KMS keys. Requires default storage.

    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  30. AI Runtime is now in Public Preview

    Adds GPU support to serverless compute for deep learning workloads.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  31. Create alerts for anomaly detection in the Data Quality Monitoring UI (Beta)

    Creates notifications for unusual data patterns, available in Beta.

  32. ABAC policy functions now use snake_case naming

    Replaces camelCase with snake_case, old forms still work but will be deprecated.

  33. Health indicators for tables in Catalog Explorer (Public Preview)

    Shows freshness and completeness status based on anomaly detection.

  34. Data quality monitoring documentation moved to Data governance (Unity Catalog)

    Moved from Data guides to Data governance chapter.

  35. Declarative Feature Engineering APIs (Beta)

    Define time-windowed aggregation features from data sources, materialize to Delta tables or Lakebase. Available in us-east-1 and us-west-2 regions.

    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(not on this cloud)
  36. Endpoint telemetry for custom model serving endpoints (Beta)

    Stores logs, traces, and metrics in Unity Catalog Delta tables using OpenTelemetry.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  37. Customer-managed keys for Unity Catalog

    Uses own encryption keys for Unity Catalog data. Replaces automatic encryption.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  38. Customer-managed keys for Unity Catalog (Beta)

    Uses own encryption keys for Unity Catalog catalogs. Replaces automatic encryption.

    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  39. Customer-managed keys for Unity Catalog (Public Preview)

    Protects data with user-owned encryption keys, replacing automatic encryption.

    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(not on this cloud)
  40. Discover page and domains (Beta)

    Groups data assets by functional area, built on governed tags.

  41. OneLake catalog federation (Beta)

    Allows read-only access to OneLake storage without copying data. Runs queries directly against file storage.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  42. File events enabled by default on new external locations

    Enabled on new locations, detects file changes for storage jobs and pipelines, can be disabled after creation.

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.