Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

334 releases of 1321

Last updated

  1. Metastore-level ABAC policies are in Beta

    Applies across every catalog in the metastore. Replaces per-catalog policy setup.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Data Classification now scans Unity Catalog views (Beta)

    Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.

    #Data Classification#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  3. The READ METADATA privilege will soon be available by default for workspaces with the compliance security profile enabled Coming soon

    Grants read-only visibility into object metadata, including security-sensitive information.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon

    Replaces cluster provisioning, available in Lakeflow Jobs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  5. The counter_diff SQL window function is now available

    Calculates differences between consecutive cumulative counter values, available in Databricks Runtime 19 and above.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. Window measures on a numeric index column in metric views

    Supports unitless offset and ranges on consecutive integer columns, useful for non-calendar periods like fiscal weeks.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Session restore for serverless jobs is in Public Preview

    Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.

    #Lakeflow#Notebooks
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Standard performance mode is now available for one-time runs in the Jobs API

    Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.

    #Lakeflow#Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. Maintenance windows for continuous pipelines

    Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  11. Managed tables in Lakeflow pipelines (Beta)

    Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  12. The Azure Databricks Excel Add-in is now generally available

    Connects Excel to Azure Databricks workspace for querying and data import. Enables Live query for pivot tables.

    #Integrations
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  13. The Databricks Excel Add-in is now generally available

    Connects Excel to Databricks workspace for querying and data import. Enables live query for pivot tables.

    #Integrations
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  14. Anaplan connector (Beta)

    Ingests Anaplan audit trail events and user account records into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  15. Anysphere Organization connector (Beta)

    Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  16. Celigo connector (Beta)

    Ingests Celigo audit log events into Databricks using an API token.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  17. External secrets in Unity Catalog (Beta)

    Connects Unity Catalog schema to AWS Secrets Manager, appearing as read-only objects.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  18. ABAC DENY policies are in Beta

    Explicitly deny MANAGE ACCESS CONTROL privilege, taking precedence over grants.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  19. Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon

    Replaces full snapshot default, improving performance and reducing cost.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. See which chunks support each ai_search answer (Beta)

    Added generate_citations option to show supporting chunks.

    #Databricks AI#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  22. time_bucket SQL function aligns timestamps to fixed-width time buckets

    Replaces date_trunc for non-calendar units, requires origin and width parameters.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  23. Zerobus Ingest into default storage is now in Public Preview

    Supports tables backed by default storage, requires Lakeflow Connect setup.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  24. Apache Arrow support for Zerobus Ingest is now generally available

    Replaces JSON and Avro formats, requires Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  25. ABAC GRANT policies are generally available for models and services

    Replaces individual privilege grants with governed tag matching.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  26. Pipeline events system table is in Beta

    Records Lakeflow pipeline event logs, capturing lifecycle transitions and errors, for querying and building alerts.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  27. Unity Catalog Skills (Beta)

    Publishes and governs agent skills, controlling access with Unity Catalog permissions.

    #Databricks AI#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  28. Atlassian Audit Logs connector (Beta)

    Ingests Atlassian organization audit log events using an API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  29. Genie Code is now available as a Lakeflow Jobs task (Beta)

    Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.

    #Genie Code#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  30. Zerobus Ingest into streaming tables is now generally available

    Works like writing to a managed Delta table with same limits and quotas.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  31. Anysphere Audit Logs connector (Beta)

    Uses Anysphere Admin API to ingest audit-log events, requires Cursor Admin API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  32. Connect to the Databricks Genie app in Microsoft Teams with your workspace URL (Public Preview)

    Replaces server hostname with workspace URL for connection.

    #Genie#Integrations
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  33. Secrets in Unity Catalog will soon be available by default for workspaces with the compliance security profile enabled Coming soon

    Replaces manual enablement, uses catalog.schema.secret namespace.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  34. The INSERT, UPDATE, and DELETE privileges are in Beta

    Require Databricks Runtime 18.1 or above, alternative to MODIFY privilege.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  35. Verkada connector (Beta)

    Ingests Verkada organization audit logs and access users using a Verkada API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  36. Context attributes in ABAC column mask and row filter policies (Beta)

    Targets request context, such as OAuth client ID and on-behalf-of status, in Unity Catalog policies.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  37. Default Python package repositories are GA for Lakeflow pipelines and classic compute

    Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.

    #Compute#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  38. Performance mode now applies to materialized view and streaming table refreshes from dbt tasks

    Now applies to dbt tasks, with optional Standard mode for lower costs, increasing latency to 4-6 minutes.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  39. Salesforce connector mTLS authentication is now generally available

    Replaces OAuth client credentials flow for API-only users, requires client certificates.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  40. Role-based access control (RBAC) is generally available

    Requires account and workspace admin setup. Enables exclusive access to sensitive data.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  41. Role-based access control (RBAC) will soon be available by default for workspaces with the compliance security profile enabled Coming soon

    Lets users assume a role with exclusive permissions, replacing accumulated permissions.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  42. Identity attributes in ABAC column mask policies (Beta)

    Targets users by attributes like department or country, using has_identity_attribute_value and has_identity_attribute_tag_match functions.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.