Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

356 releases of 1321

Last updated

  1. Lakebase Search is generally available

    Adds scalable vector and keyword search to Lakebase projects via Postgres extensions.

    #Lakebase
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  2. Metastore-level ABAC policies are in Beta

    Applies across every catalog in the metastore. Replaces per-catalog policy setup.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  3. Data Classification now scans Unity Catalog views (Beta)

    Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.

    #Data Classification#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. Lakebase snapshots API (Beta)

    Manages point-in-time snapshots of project branches, allowing create, get, list, delete, and restore operations.

    #Lakebase
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  5. The READ METADATA privilege will soon be available by default for workspaces with the compliance security profile enabled Coming soon

    Grants read-only visibility into object metadata, including security-sensitive information.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon

    Replaces cluster provisioning, available in Lakeflow Jobs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. The counter_diff SQL window function is now available

    Calculates differences between consecutive cumulative counter values, available in Databricks Runtime 19 and above.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Window measures on a numeric index column in metric views

    Supports unitless offset and ranges on consecutive integer columns, useful for non-calendar periods like fiscal weeks.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. Session restore for serverless jobs is in Public Preview

    Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.

    #Lakeflow#Notebooks
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  11. Standard performance mode is now available for one-time runs in the Jobs API

    Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.

    #Lakeflow#Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  12. Maintenance windows for continuous pipelines

    Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  13. Managed tables in Lakeflow pipelines (Beta)

    Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  14. Anaplan connector (Beta)

    Ingests Anaplan audit trail events and user account records into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  15. Anysphere Organization connector (Beta)

    Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  16. Celigo connector (Beta)

    Ingests Celigo audit log events into Databricks using an API token.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  17. External secrets in Unity Catalog (Beta)

    Connects Unity Catalog schema to AWS Secrets Manager, appearing as read-only objects.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  18. ABAC DENY policies are in Beta

    Explicitly deny MANAGE ACCESS CONTROL privilege, taking precedence over grants.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  19. Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon

    Replaces full snapshot default, improving performance and reducing cost.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Lakebase now supports PCI-DSS and HITRUST in all AWS regions

    Requires compliance security profile enabled. Previously limited to us-east-1 region.

    #Lakebase
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(unknown)
  22. See which chunks support each ai_search answer (Beta)

    Added generate_citations option to show supporting chunks.

    #Databricks AI#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  23. time_bucket SQL function aligns timestamps to fixed-width time buckets

    Replaces date_trunc for non-calendar units, requires origin and width parameters.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  24. Zerobus Ingest into default storage is now in Public Preview

    Supports tables backed by default storage, requires Lakeflow Connect setup.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  25. Lakebase now available in Azure Japan East region (japaneast)

    Available in japaneast region, requires Postgres database setup.

    #Lakebase
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  26. Apache Arrow support for Zerobus Ingest is now generally available

    Replaces JSON and Avro formats, requires Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  27. ABAC GRANT policies are generally available for models and services

    Replaces individual privilege grants with governed tag matching.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  28. Pipeline events system table is in Beta

    Records Lakeflow pipeline event logs, capturing lifecycle transitions and errors, for querying and building alerts.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  29. Unity Catalog Skills (Beta)

    Publishes and governs agent skills, controlling access with Unity Catalog permissions.

    #Databricks AI#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  30. Atlassian Audit Logs connector (Beta)

    Ingests Atlassian organization audit log events using an API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  31. Genie Code is now available as a Lakeflow Jobs task (Beta)

    Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.

    #Genie Code#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  32. Zerobus Ingest into streaming tables is now generally available

    Works like writing to a managed Delta table with same limits and quotas.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  33. Anysphere Audit Logs connector (Beta)

    Uses Anysphere Admin API to ingest audit-log events, requires Cursor Admin API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  34. LTAP Direct Writes accelerates synced table loads (Beta)

    Requires Postgres 17, enabled from Previews page. Writes directly to storage layer.

    #Lakebase
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(unknown)
  35. Genie Code is now available in the Lakebase project UI

    Lets you run multi-step data and AI tasks with natural language input. Available for all Lakebase projects.

    #Lakebase
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  36. Postgres minor version updates

    Updates to 16.15, 17.11, and 18.6, applied on compute restart.

    #Lakebase
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  37. Secrets in Unity Catalog will soon be available by default for workspaces with the compliance security profile enabled Coming soon

    Replaces manual enablement, uses catalog.schema.secret namespace.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  38. The INSERT, UPDATE, and DELETE privileges are in Beta

    Require Databricks Runtime 18.1 or above, alternative to MODIFY privilege.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  39. Verkada connector (Beta)

    Ingests Verkada organization audit logs and access users using a Verkada API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  40. Context attributes in ABAC column mask and row filter policies (Beta)

    Targets request context, such as OAuth client ID and on-behalf-of status, in Unity Catalog policies.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  41. Default Python package repositories are GA for Lakeflow pipelines and classic compute

    Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.

    #Compute#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  42. Lakebase adds compliance security profile standards on Azure

    Supports ISMAP, IRAP, and UK Cyber Essentials Plus on Azure.

    #Lakebase
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.