Databricks releases, every cloud
- REPLACE USING flows for standalone streaming tables (Beta)
Replaces rows matching specified key columns, requires SEQUENCE BY column.
- Alert system tables are in Public Preview
Contains alerts and alert_evaluation_history tables for auditing and monitoring.
- Lakebase now supports PCI-DSS and HITRUST
Requires compliance security profile, limited to us-east-1 on AWS.
- Notion connector (Beta)
Ingests Notion pages, databases, and users into Databricks.
- Orchestrate continuous pipelines with continuous jobs
Determines execution mode, allows serverless Standard performance mode. Replaces pipeline's built-in continuous setting.
- Change data feed on materialized views (Beta)
Requires Databricks Runtime 18 LTS or above. Enables replication to external destinations.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- JAR tasks on serverless compute are now generally available
Requires matching Scala, Java Development Kit, and Databricks Connect versions.
- Zerobus Ingest is now enabled by default for workspaces with the compliance security profile
Replaces manual connector setup for compliant workspaces.
- Lakebase is enabled by default in compliance security profile workspaces
Replaces manual Lakebase enablement in HIPAA, C5, or TISAX workspaces.
- REPLACE USING flows for pipelines (Beta)
Replaces rows matching specified key columns, doesn't require change data capture feed or primary key.
- Google Drive connector (GA)
Supports fully managed and custom ingestion pipelines with Spark and SQL APIs.
- NetSuite connector (GA)
Ingests ERP and financial data from Oracle NetSuite into Databricks.
- PagerDuty connector (Beta)
Ingests incident, on-call, service, and audit data from PagerDuty into Databricks.
- SharePoint connector (GA)
Includes managed and standard connectors for ingestion pipelines.
- Automatic cost attribution for materialized views and streaming tables in Databricks SQL
Inherits custom tags from enclosing SQL warehouse environment for billing.
- OpenAI connector (Beta)
Uses OpenAI Organization Admin API to ingest admin data, authenticates with OpenAI Admin API key.
- Unit testing for pipelines (Beta)
Validates Python and SQL transformations against mock data. Requires Lakeflow Pipelines Editor.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Diagnose and fix Lakebase issues with Genie, using telemetry in Unity Catalog (Beta)
Uses Unity Catalog database telemetry and conversation with Genie for troubleshooting.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- C++ SDK for the Zerobus Ingest connector is now available in Beta
Supports JSON and Protocol Buffers for ingesting into Unity Catalog Delta tables.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Override the REPLACE WHERE predicate for a single refresh
Adds a WHERE clause to the REFRESH STREAMING TABLE command. Applies to standalone streaming tables with FLOW REPLACE WHERE clause.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Reddit Ads connector is now available in Beta
Ingests advertising campaign data and performance metrics from Reddit Ads into Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Warehouse-level statement timeouts (Beta)
Set via statement_timeout field in Create or Update warehouse APIs.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Anthropic managed ingestion connector (Beta)
Ingests Compliance API data, including audit activity and Claude chats, into Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Agentic code converter is in Beta
Converts T-SQL, Snowflake, and other dialects to ANSI SQL. Requires workspace admin enablement.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Lakebase now provides a service level agreement (SLA)
Commits to monthly uptime percentage for zone-redundant and single-compute endpoints.
- Lakebase is now SOC 2 Type 2 compliant
SOC 2 Type 2 compliance covers security and availability controls. Reports are available through account teams.
- Query-based connectors in Lakeflow Connect will soon be available by default for workspaces with the compliance security profile enabled Coming soon
Replaces CDC configuration, supports Oracle, Teradata, and others.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Lakebase update notifications now post 3 days in advance
Replaces 7-day notice, check project settings for upcoming updates.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Change to default pipeline editor for workspaces with the compliance security profile enabled Coming soon
Replaces legacy editor, removing it in August.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks SQL alerts are now available by default for workspaces with the compliance security profile enabled
Supports all compliance security profile standards, monitors data and KPIs via scheduled queries.
- Strac connector (Beta)
Ingests Strac data-security audit events using a Strac API key.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Behavior changes for continuous jobs and pipelines Coming soon
Configures continuous schedule from pipeline page, wrapping pipeline in a continuous job. Replaces pipeline's built-in continuous setting for new pipelines.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Excel file format support is now available by default
Supports .xls, .xlsx, and .xlsm files without external libraries.
- REPLACE WHERE flows are now generally available
Replaces full table reprocessing with row-level updates based on a predicate.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Standard performance mode is now supported for materialized view or streaming table refreshes in jobs
Consumes fewer DBUs when Performance optimized setting is off.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Lakeflow Connect row filtering is now generally available
Works like a SQL WHERE clause, applies to initial and incremental updates.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Veeva Vault connector (Beta)
Ingests standard and custom objects from Veeva using OAuth 2.0 M2M auth.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Lakebase now available in AWS Tokyo region (ap-northeast-1)
Available in ap-northeast-1, supports Postgres database.
- Lakehouse Real-Time (Beta)
Delivers sub-second SQL read queries against Unity Catalog tables. Built for low-latency workloads.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - MATCH_RECOGNIZE is now in Beta
Requires enabling Match Recognize preview in workspace settings.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.