Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

58 releases of 1321

Last updated

  1. Metastore-level ABAC policies are in Beta

    Applies across every catalog in the metastore. Replaces per-catalog policy setup.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Session restore for serverless jobs is in Public Preview

    Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.

    #Lakeflow#Notebooks
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  3. ABAC DENY policies are in Beta

    Explicitly deny MANAGE ACCESS CONTROL privilege, taking precedence over grants.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. Zerobus Ingest into default storage is now in Public Preview

    Supports tables backed by default storage, requires Lakeflow Connect setup.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  5. Pipeline events system table is in Beta

    Records Lakeflow pipeline event logs, capturing lifecycle transitions and errors, for querying and building alerts.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. The INSERT, UPDATE, and DELETE privileges are in Beta

    Require Databricks Runtime 18.1 or above, alternative to MODIFY privilege.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Unity Catalog ABAC GRANT policies support more securable types in Beta

    Now supports model services, model provider services, MCP services, and agent services, in addition to models.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Alert system tables are in Public Preview

    Contains alerts and alert_evaluation_history tables for auditing and monitoring.

    #Databricks SQL#System tables & audit logs
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. Governed tags system table is in Beta

    Contains records for each governed tag key, including customer-created and system-generated tags.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  11. C++ SDK for the Zerobus Ingest connector is now available in Beta

    Supports JSON and Protocol Buffers for ingesting into Unity Catalog Delta tables.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  12. Role-based access control (RBAC) is in Public Preview

    Lets users assume a role with limited permissions. Requires account and workspace admin setup.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  13. Reddit Ads connector is now available in Beta

    Ingests advertising campaign data and performance metrics from Reddit Ads into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  14. Secrets in Unity Catalog (Public Preview)

    Uses three-level namespace and Unity Catalog privileges for access control.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  15. Restrict access to AI Functions with Unity Catalog permissions (Public Preview)

    Requires account team enablement, restricts access to task-specific AI Functions.

    #Databricks AI#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  16. MATCH_RECOGNIZE is now in Beta

    Requires enabling Match Recognize preview in workspace settings.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  17. Metric view parameters are now in Public Preview

    binds values at query time, replacing separate views per variant.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  18. Enable access requests across your Unity Catalog metastore (Public Preview)

    Enables requests at metastore level, inherited by all catalogs and schemas.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  19. The Discover page is now in Public Preview

    Helps find Unity Catalog data assets without requiring catalog hierarchy knowledge. Organizes tables and dashboards by business area.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Configure the recovery period for dropped managed tables (Public Preview)

    Sets recovery period to 0 hours or 7-30 days, requires Databricks Runtime 17.3.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  22. Databricks-to-Databricks Delta Sharing across regulatory domains is now available (Public Preview)

    Supports sharing with AWS GovCloud, AWS GovCloud DoD, and Azure China.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  23. External data access for pipeline streaming tables and materialized views (Public Preview)

    Enables external Delta and Iceberg clients to read data without copying. Uses Unity Catalog and Iceberg catalog REST APIs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  24. UNIQUE constraint support is now in Public Preview

    Enables join elimination and DISTINCT simplification on Photon-enabled compute. Applies to Unity Catalog Delta Lake tables.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  25. Real-time mode in Spark Declarative Pipelines on Lakeflow, and the update_flow API are now available (Public Preview)

    Achieves end-to-end latency as low as 5ms, uses update output mode.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  26. Spark Declarative Pipelines on Lakeflow parameters are now in Beta

    Define key-value pairs at pipeline level, referenced in SQL using named parameter syntax.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  27. SQL alert task in Lakeflow Jobs is now in Public Preview

    Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state as output.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  28. MLflow trace storage in Unity Catalog is now in Public Preview

    Stores OpenTelemetry traces, governed by Unity Catalog permissions, queryable from Databricks SQL or MLflow Python SDK.

    #MLflow#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  29. 5X-Large SQL warehouse size (Public Preview)

    Provides 512 workers, available in all regions, controlled from Previews page.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  30. Lakeflow Designer is now in Public Preview

    Offers drag-and-drop canvas and natural language for building data workflows.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  31. Query-based connectors for Lakeflow Connect (Public Preview)

    Ingests data from databases using a cursor column, supporting Oracle, Teradata, and others.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  32. Health indicators for tables in Catalog Explorer (Public Preview)

    Shows freshness and completeness status based on anomaly detection.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  33. Customer-managed keys for Unity Catalog (Public Preview)

    Protects data with user-owned encryption keys, replacing automatic encryption.

    #Security#Unity Catalog
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(not on this cloud)
  34. JAR tasks on serverless compute is now in Public Preview

    Allows running JAR jobs without a cluster.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  35. Configure default Python package repositories for Spark Declarative Pipelines on Lakeflow (Public Preview)

    Allows installation from internal Python repositories without index-url or extra-index-url. Requires workspace admin configuration.

    #Admin Guide#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  36. Tag Databricks Apps (Public Preview)

    Organize and categorize apps, but search is not supported.

    #Databricks Apps#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  37. MySQL connector in Lakeflow Connect (Public Preview)

    Enables incremental data ingestion from various MySQL databases. Requires access request through account team.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  38. PostgreSQL connector in Lakeflow Connect (Public Preview)

    Enables incremental data ingestion from various PostgreSQL databases. Requires configuration.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  39. Microsoft Dynamics 365 connector (Public Preview)

    Ingests data from Dynamics 365 apps into Databricks. Requires Lakeflow Connect.

    #Data ingestion#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  40. NetSuite connector (Public Preview)

    Ingests data from NetSuite2.com via API, CLI, or notebook.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  41. ForEachBatch for Spark Declarative Pipelines on Lakeflow is available (Public Preview)

    Allows processing streams as micro-batches in Python. Requires Lakeflow setup.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  42. ABAC-secured assets shared using Delta Sharing is in Public Preview

    Applies to tables and schemas, but not streaming tables or materialized views.

    #Delta Sharing#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.