Databricks releases, every cloud
- Managed RabbitMQ connector (Beta)
Streams messages from RabbitMQ classic queues into Unity Catalog streaming tables.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Pendo connector (Beta)
Ingests data from Pendo into Lakeflow. Requires Lakeflow Connect.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Query-based connectors for Lakeflow Connect are now generally available
Ingests data from databases like Oracle and PostgreSQL without CDC configuration.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Google Drive managed ingestion connector (Beta)
Ingests files from Google Drive into Databricks, supporting unstructured and structured data.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Real-time mode in Spark Declarative Pipelines on Lakeflow, and the update_flow API are now available (Public Preview)
Achieves end-to-end latency as low as 5ms, uses update output mode.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Refresh policies and EXPLAIN CREATE MATERIALIZED VIEW for materialized views are now generally available
Requires Databricks Runtime 17.3 and above. Available in Databricks SQL.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Spark Declarative Pipelines on Lakeflow parameters are now in Beta
Define key-value pairs at pipeline level, referenced in SQL using named parameter syntax.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Configure Microsoft Entra ID SSO for Power BI (Public Preview)
Uses account-level federation policy, replacing manual config.
- Azure Databricks Add-in for Excel support for all compliance security profile standards
Supports all Azure Databricks compliance security profiles.
- Databricks Add-in for Excel support for all compliance security profile standards
Supports all Databricks compliance security profiles. Requires Public Preview.
- Unified runs list is generally available
Replaces separate job and pipeline run lists, adds filtering and error code visualization.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Spark Declarative Pipelines on Lakeflow sinks are now generally available
Supports writing to Delta tables, Kafka topics, and Azure Event Hubs.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Publish a Unity Catalog catalog to Microsoft Fabric (Beta)
Creates a read-only mirrored catalog, allowing Fabric users to query Unity Catalog tables without data movement.
- Spark Declarative Pipelines on Lakeflow environment versions (Beta)
Pins Python version and libraries, decoupling from Databricks Runtime upgrades.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - SQL alert task in Lakeflow Jobs is now in Public Preview
Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state as output.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - View run history for scheduled refreshes in Google Sheets
Shows Run ID, start time, and success status for each run.
- HIPAA support for the Azure Databricks Add-in for Excel
Available for workspaces with HIPAA compliance across all supported regions. Requires a workspace with HIPAA compliance enabled.
- HIPAA support for the Databricks Add-in for Excel
Available for workspaces with HIPAA compliance across all supported regions.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- HubSpot connector (GA)
Ingests data from HubSpot Marketing Hub into Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Standalone pipelines on serverless general compute (Beta)
Requires serverless general compute, created via SQL or Python.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - GitHub managed ingestion connector (Beta)
ingests GitHub data into Databricks, available in Lakeflow Connect.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Outlook managed ingestion connector (Beta)
Ingests email data from Microsoft Outlook into Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Smartsheet managed ingestion connector (Beta)
Ingests Smartsheet data into Databricks, available in Lakeflow Connect.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Lakeflow Pipelines Editor is now generally available
Offers agent-first experience with Genie Code for creating production pipelines.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Community connectors (Beta)
Extends Lakeflow Connect to unsupported sources, built by the community.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Disabling tasks in Lakeflow Jobs is now GA
Disabled tasks retain config and run history, can be re-enabled later.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Zendesk Support connector (GA)
Allows syncing Zendesk tickets to Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Confluence connector (GA)
Allows reading Confluence spaces and pages into Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Azure Databricks Excel Add-in requires workspace preview enablement
Enabled from the Previews page by a workspace admin.
- Databricks Excel Add-in requires workspace preview enablement
Enabled from the Previews page by a workspace admin.
- Lakeflow Designer is now in Public Preview
Offers drag-and-drop canvas and natural language for building data workflows.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Query-based connectors for Lakeflow Connect (Public Preview)
Ingests data from databases using a cursor column, supporting Oracle, Teradata, and others.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Connect Lovable apps to Azure Databricks
Uses REST API and OAuth authentication. Requires machine-to-machine authentication setup.
- Connect Lovable apps to Databricks
Uses REST API and OAuth machine-to-machine authentication.
- New cascade field for deleting Unity Catalog pipelines (Beta)
Deletes associated materialized views and tables by default, set cascade=false to retain them.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon
Deletes now retain associated tables by default, set cascade=true to remove them.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks Documentation site table of contents tabs
Replaces static sidebar with tabbed navigation, includes 6 context tabs.
- Databricks Connector for Google Sheets updates
Longer query execution timeout and UI improvements added.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks JDBC driver 2.8.0 is available
Replaces Log4j with SLF4J 2.0.13, enables telemetry by default.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks SQL pipelines support notifications and performance mode (Beta)
Supports failure notifications and serverless performance mode for materialized views and streaming tables.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.