Skip to content

Databricks releases, every cloud

51 releases of 1321

Last updated

  1. Unit testing for pipelines (Beta)

    Validates Python and SQL transformations against mock data. Requires Lakeflow Pipelines Editor.

  2. Override the REPLACE WHERE predicate for a single refresh

    Adds a WHERE clause to the REFRESH STREAMING TABLE command. Applies to standalone streaming tables with FLOW REPLACE WHERE clause.

  3. Anthropic managed ingestion connector (Beta)

    Ingests Compliance API data, including audit activity and Claude chats, into Databricks.

  4. Change to default pipeline editor for workspaces with the compliance security profile enabled Coming soon

    Replaces legacy editor, removing it in August.

  5. Strac connector (Beta)

    Ingests Strac data-security audit events using a Strac API key.

  6. Standard performance mode is now supported for materialized view or streaming table refreshes in jobs

    Consumes fewer DBUs when Performance optimized setting is off.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Veeva Vault connector (Beta)

    Ingests standard and custom objects from Veeva using OAuth 2.0 M2M auth.

  9. Run a subset of job tasks with their dependencies

    Add + modifier to task key to include dependencies, usable via UI, API, or CLI.

  10. Microsoft Dynamics 365 connector (GA)

    Ingests CRM and ERP data into Databricks using Azure Synapse Link.

  11. Change the owner of standalone pipeline streaming tables and materialized views

    Uses ALTER STREAMING TABLE and ALTER MATERIALIZED VIEW with SET OWNER TO. Applies to standalone pipeline datasets in Databricks SQL.

  12. Standalone pipeline materialized views support expectations

    Validates records in materialized views using CONSTRAINT clause. Replaces manual validation in standalone pipelines.

  13. Square managed ingestion connector (Beta)

    Ingests point-of-sale data like payments and orders from Square into Databricks.

  14. Wiz Audit Logs managed ingestion connector (Beta)

    Ingests Wiz audit log entries, issues, and vulnerability findings into Databricks.

  15. Netskope Logs managed ingestion connector (Beta)

    Ingests Netskope event and alert logs into Databricks.

  16. Incremental ingestion for Workday Reports (Beta)

    Ingests only changed rows since last pipeline run if a cursor column is configured.

  17. Salesforce Marketing Cloud managed ingestion connector (Beta)

    Ingests campaigns, journeys, and email events from Salesforce Marketing Cloud into Databricks.

  18. Zip connector (Beta)

    Ingests data from Zip, a new option in Lakeflow Connect.

  19. Reorganized Spark Declarative Pipelines on Lakeflow documentation

    Conceptual topics are now under Concepts.

  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Aha! connector (Beta)

    Ingests data from Aha!, using Lakeflow Connect.

  22. Monday.com managed ingestion connector (Beta)

    Ingests boards, users, teams, and activity logs from Monday.com into Databricks.

  23. Zoho Books managed ingestion connector (Beta)

    Ingests invoices, bills, contacts, and bank transactions from Zoho Books into Databricks.

  24. Managed SharePoint connector adds structured file ingestion and file metadata support (Beta)

    Supports CSV, JSON, XML, Excel, Parquet, Avro, ORC ingestion, replacing unstructured-only approach.

  25. Write data from Microsoft Excel back to Azure Databricks

    Writes to Unity Catalog tables, overwriting existing ones if needed.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  26. Write data from Microsoft Excel back to Databricks

    Writes to Unity Catalog tables, overwriting existing ones if needed.

    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  27. Table update triggers on Delta Sharing and system tables (Beta)

    Monitors data shared through Delta Sharing and system tables, triggering jobs on updates, supporting Databricks-to-Databricks sharing only.

  28. Managed RabbitMQ connector (Beta)

    Streams messages from RabbitMQ classic queues into Unity Catalog streaming tables.

  29. Pendo connector (Beta)

    Ingests data from Pendo into Lakeflow. Requires Lakeflow Connect.

  30. Google Drive managed ingestion connector (Beta)

    Ingests files from Google Drive into Databricks, supporting unstructured and structured data.

  31. Azure Databricks Add-in for Excel support for all compliance security profile standards

    Supports all Azure Databricks compliance security profiles.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  32. Databricks Add-in for Excel support for all compliance security profile standards

    Supports all Databricks compliance security profiles. Requires Public Preview.

    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  33. Publish a Unity Catalog catalog to Microsoft Fabric (Beta)

    Creates a read-only mirrored catalog, allowing Fabric users to query Unity Catalog tables without data movement.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  34. Spark Declarative Pipelines on Lakeflow environment versions (Beta)

    Pins Python version and libraries, decoupling from Databricks Runtime upgrades.

  35. HIPAA support for the Azure Databricks Add-in for Excel

    Available for workspaces with HIPAA compliance across all supported regions. Requires a workspace with HIPAA compliance enabled.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  36. HIPAA support for the Databricks Add-in for Excel

    Available for workspaces with HIPAA compliance across all supported regions.

    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  37. HubSpot connector (GA)

    Ingests data from HubSpot Marketing Hub into Databricks.

  38. Standalone pipelines on serverless general compute (Beta)

    Requires serverless general compute, created via SQL or Python.

  39. GitHub managed ingestion connector (Beta)

    ingests GitHub data into Databricks, available in Lakeflow Connect.

  40. Outlook managed ingestion connector (Beta)

    Ingests email data from Microsoft Outlook into Databricks.

  41. Smartsheet managed ingestion connector (Beta)

    Ingests Smartsheet data into Databricks, available in Lakeflow Connect.

  42. Community connectors (Beta)

    Extends Lakeflow Connect to unsupported sources, built by the community.

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.