Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

33 releases of 1354

Last updated

  1. Tags for dashboards, notebooks, Databricks apps, and Genie Agents are now generally available

    Tags support both governed and ungoverned key-value pairs. They can be applied to organize workspace assets.

    #Unity Catalog
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  2. Scalar and Batch Unity Catalog Python UDFs are now generally available

    They work on all supported compute types and remove the five-UDF-call-per-query limit. Environment version 6 or above is required for some capabilities.

    #Unity Catalog
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  3. HITRUST and IRAP compliance controls are now generally available

    Available through compliance security profile, required for HIPAA, HITRUST, and IRAP.

    #Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  4. ABAC GRANT policies are generally available for models and services

    They grant Unity Catalog privileges based on governed tags, replacing individual object grants.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  5. Consumer access to query Unity Gateway services will become generally available Coming soon

    Requires account admins to set budgets and rate limits beforehand to control model traffic.

    #Databricks AI#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. Role-based access control (RBAC) is generally available

    Requires account and workspace admin setup. Enables exclusive access to sensitive data.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Schema-level HTTP connections in Unity Catalog are now generally available

    Creates connections inside a schema, inheriting its privileges, instead of only at metastore level.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Python UDTFs in Unity Catalog are now generally available

    Runs on serverless compute, classic compute, and SQL warehouses. Requires Databricks Runtime 18.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  10. Email notifications for expiring service principal tokens are now generally available

    Sends emails to workspace admins 7 days before token expiration for used tokens with lifetime over 7 days. No configuration is required.

    #Administration#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  11. Context-based ingress control for workspaces public access is now generally available

    Uses allow and deny rules to control access based on identities, network sources, and request types.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  12. MLflow trace storage in Unity Catalog is now generally available

    Stores traces in OpenTelemetry format with unlimited storage and SQL query access.

    #MLflow#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  13. OneLake catalog federation is generally available

    Allows reading OneLake data without copying, with read-only access and direct queries against file storage.

    #Lakehouse Federation#Unity Catalog
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  14. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  15. External lineage is now generally available

    Registers external assets like Salesforce or MySQL sources and Tableau dashboards. Automatically records source lineage for Lakeflow Connect pipelines.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  16. Inbound Private Link for performance-intensive services is now generally available

    Supports Lakebase Autoscaling and Zerobus Ingest.

    #Networking#Security
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  17. Refresh policies and EXPLAIN CREATE MATERIALIZED VIEW for materialized views are now generally available

    Requires Databricks Runtime 17.3 and above. Available in Databricks SQL.

    #Databricks SQL#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  18. Automatic identity management with Microsoft Entra ID is now GA

    Replaces SCIM provisioning, syncs users and groups from Microsoft Entra ID.

    #Security
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP, read it on their docs
  19. Unity Catalog managed Apache Iceberg tables, foreign Apache Iceberg tables, and Apache Iceberg v3 features are generally available

    Supports liquid clustering, predictive optimization, and materialized views. Requires Databricks Runtime or external Iceberg-compatible engines.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Databricks SQL alerts are now generally available

    Monitors data and KPIs by running scheduled queries, notifying recipients when conditions are met.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  22. Catalog commits are now generally available

    Enables multi-statement transactions on Unity Catalog managed Delta tables, supported by products like MLflow and Delta Sharing.

    #Delta Lake#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  23. Attribute-based access control (ABAC) is now generally available

    Uses governed tags to enforce row filter and column mask policies. Replaces per-table configuration with automatic application at catalog, schema, or table level.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  24. Databricks Data Classification is now GA

    Automatically classifies and tags sensitive data in Unity Catalog using AI.

    #Data Classification#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  25. Altering a catalog or schema's managed storage location is now GA

    Modifies default cloud storage location for new managed tables and volumes.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  26. C5, TISAX, and K-FSI compliance controls are now generally available

    Available on Azure, providing enhancements for workspace compliance requirements.

    #Compliance#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  27. Scoped personal access tokens are now generally available

    Restrict tokens to specific API operations with specified permissions. Coming soon to compliance security profile workspaces.

    #Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  28. Governed tags are generally available

    Allow administrators to define controlled tags for Unity Catalog and workspace objects, enforcing consistent metadata tagging.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  29. Customer-managed keys for Unity Catalog are generally available

    Encrypts data in Unity Catalog catalogs using cloud KMS keys. Requires default storage.

    #Security#Unity Catalog
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  30. Update workspace network configuration to VNet injection is now GA

    Migrates from Databricks-managed VNet to customer-owned VNet.

    #Networking#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  31. Azure virtual network service endpoint policies are now generally available

    Apply to classic compute for outbound storage access filtering. Requires configuration.

    #Networking#Security
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  32. Enhanced Security and Compliance add-on is now generally available

    includes compliance security profile and enhanced security monitoring.

    #Compliance#Security
    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  33. Serverless egress control is now generally available

    Manages outbound connections with restricted access and FQDN filtering.

    #Networking#Security
    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  34. GCP Private Service Connect generally available

    No account team request needed to enable.

    #Networking#Security
    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  35. New SQL editor is generally available

    Provides a unified authoring environment with features like real-time collaboration and enhanced Databricks Assistant integration.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.

We measure how the site is used. PostHog and Google Analytics, set to measurement only with advertising features off. We do not sell your data or share it for advertising, and you can turn this off. What this stores.