Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

189 releases of 1321

Last updated

  1. REPLACE USING flows for pipelines (Beta)

    Replaces rows matching specified key columns, doesn't require change data capture feed or primary key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Google Drive connector (GA)

    Supports fully managed and custom ingestion pipelines with Spark and SQL APIs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  3. NetSuite connector (GA)

    Ingests ERP and financial data from Oracle NetSuite into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. PagerDuty connector (Beta)

    Ingests incident, on-call, service, and audit data from PagerDuty into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  5. SharePoint connector (GA)

    Includes managed and standard connectors for ingestion pipelines.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. Sharing Delta tables with deletion vectors and column mapping is now generally available

    Enables sharing tables with deletion vectors or column mapping. Requires setup in Add tables with deletion vectors or column mapping to a share.

    #Delta Sharing
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Sharing Delta tables with Iceberg reads enabled is now generally available

    Enables reading Delta tables as Iceberg tables, requires Databricks Runtime 8.4 or above.

    #Delta Sharing
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Automatic cost attribution for materialized views and streaming tables in Databricks SQL

    Inherits custom tags from enclosing SQL warehouse environment for billing.

    #Databricks SQL#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. OpenAI connector (Beta)

    Uses OpenAI Organization Admin API to ingest admin data, authenticates with OpenAI Admin API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  11. Unit testing for pipelines (Beta)

    Validates Python and SQL transformations against mock data. Requires Lakeflow Pipelines Editor.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  12. C++ SDK for the Zerobus Ingest connector is now available in Beta

    Supports JSON and Protocol Buffers for ingesting into Unity Catalog Delta tables.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  13. Databricks-hosted sample datasets available in the samples catalog

    Available in Unity Catalog-enabled workspaces through OpenSharing as samples.databricks.datasets.

    #Delta Sharing#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  14. Override the REPLACE WHERE predicate for a single refresh

    Adds a WHERE clause to the REFRESH STREAMING TABLE command. Applies to standalone streaming tables with FLOW REPLACE WHERE clause.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  15. Reddit Ads connector is now available in Beta

    Ingests advertising campaign data and performance metrics from Reddit Ads into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  16. Anthropic managed ingestion connector (Beta)

    Ingests Compliance API data, including audit activity and Claude chats, into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  17. Query-based connectors in Lakeflow Connect will soon be available by default for workspaces with the compliance security profile enabled Coming soon

    Replaces CDC configuration, supports Oracle, Teradata, and others.

    #Lakeflow#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  18. Trigger.AvailableNow support for OpenSharing streaming (GA)

    Replaces Trigger.Once, requires Databricks Runtime 18.0 or above.

    #Delta Sharing
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  19. Change to default pipeline editor for workspaces with the compliance security profile enabled Coming soon

    Replaces legacy editor, removing it in August.

    #Lakeflow#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Strac connector (Beta)

    Ingests Strac data-security audit events using a Strac API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  22. Behavior changes for continuous jobs and pipelines Coming soon

    Configures continuous schedule from pipeline page, wrapping pipeline in a continuous job. Replaces pipeline's built-in continuous setting for new pipelines.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  23. Excel file format support is now available by default

    Supports .xls, .xlsx, and .xlsm files without external libraries.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  24. REPLACE WHERE flows are now generally available

    Replaces full table reprocessing with row-level updates based on a predicate.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  25. Standard performance mode is now supported for materialized view or streaming table refreshes in jobs

    Consumes fewer DBUs when Performance optimized setting is off.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  26. Lakeflow Connect row filtering is now generally available

    Works like a SQL WHERE clause, applies to initial and incremental updates.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  27. Veeva Vault connector (Beta)

    Ingests standard and custom objects from Veeva using OAuth 2.0 M2M auth.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  28. Run a subset of job tasks with their dependencies

    Add + modifier to task key to include dependencies, usable via UI, API, or CLI.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  29. SQL alert task in Lakeflow Jobs is now generally available

    Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state for downstream tasks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  30. Microsoft Dynamics 365 connector (GA)

    Ingests CRM and ERP data into Databricks using Azure Synapse Link.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  31. Change the owner of standalone pipeline streaming tables and materialized views

    Uses ALTER STREAMING TABLE and ALTER MATERIALIZED VIEW with SET OWNER TO. Applies to standalone pipeline datasets in Databricks SQL.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  32. Standalone pipeline materialized views support expectations

    Validates records in materialized views using CONSTRAINT clause. Replaces manual validation in standalone pipelines.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  33. Square managed ingestion connector (Beta)

    Ingests point-of-sale data like payments and orders from Square into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  34. Wiz Audit Logs managed ingestion connector (Beta)

    Ingests Wiz audit log entries, issues, and vulnerability findings into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  35. Netskope Logs managed ingestion connector (Beta)

    Ingests Netskope event and alert logs into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  36. Incremental ingestion for Workday Reports (Beta)

    Ingests only changed rows since last pipeline run if a cursor column is configured.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  37. Salesforce Marketing Cloud managed ingestion connector (Beta)

    Ingests campaigns, journeys, and email events from Salesforce Marketing Cloud into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  38. OIDC is now supported for sharing to Iceberg clients

    Supports Iceberg REST Catalog clients like Snowflake or OSS Spark. Requires OpenID Connect federation.

    #Delta Sharing
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  39. Zip connector (Beta)

    Ingests data from Zip, a new option in Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  40. Reorganized Spark Declarative Pipelines on Lakeflow documentation

    Conceptual topics are now under Concepts.

    #Documentation#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  41. The update_flow API for Spark Declarative Pipelines on Lakeflow is generally available

    Writes to a sink in update output mode, emitting only changed rows. Supports stateful aggregations without a watermark.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  42. Aha! connector (Beta)

    Ingests data from Aha!, using Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.