Databricks releases, every cloud
- Python UDTFs in Unity Catalog are now generally available
Runs on serverless compute, classic compute, and SQL warehouses. Requires Databricks Runtime 18.
- Unit testing for pipelines (Beta)
Validates Python and SQL transformations against mock data. Requires Lakeflow Pipelines Editor.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Governed tags system table is in Beta
Contains records for each governed tag key, including customer-created and system-generated tags.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - C++ SDK for the Zerobus Ingest connector is now available in Beta
Supports JSON and Protocol Buffers for ingesting into Unity Catalog Delta tables.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Automated setup for S3 external locations
Uses AWS IAM temporary delegation to configure external locations and provision required resources.
- Databricks-hosted sample datasets available in the samples catalog
Available in Unity Catalog-enabled workspaces through OpenSharing as samples.databricks.datasets.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Override the REPLACE WHERE predicate for a single refresh
Adds a WHERE clause to the REFRESH STREAMING TABLE command. Applies to standalone streaming tables with FLOW REPLACE WHERE clause.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Role-based access control (RBAC) is in Public Preview
Lets users assume a role with limited permissions. Requires account and workspace admin setup.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Reddit Ads connector is now available in Beta
Ingests advertising campaign data and performance metrics from Reddit Ads into Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Warehouse-level statement timeouts (Beta)
Set via statement_timeout field in Create or Update warehouse APIs.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Anthropic managed ingestion connector (Beta)
Ingests Compliance API data, including audit activity and Claude chats, into Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - MLflow trace storage in Unity Catalog is now generally available
Stores traces in OpenTelemetry format with unlimited storage and SQL query access.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Data Classification is now available by default for additional compliance standards
Requires compliance security profile with C5, TISAX, or IRAP controls.
- Query-based connectors in Lakeflow Connect will soon be available by default for workspaces with the compliance security profile enabled Coming soon
Replaces CDC configuration, supports Oracle, Teradata, and others.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Request for Access will soon be enabled by default for all workspaces Coming soon
Routes requests to Unity Catalog object owners via email, replacing workspace-level settings.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Secrets in Unity Catalog (Public Preview)
Uses three-level namespace and Unity Catalog privileges for access control.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Change to default pipeline editor for workspaces with the compliance security profile enabled Coming soon
Replaces legacy editor, removing it in August.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks SQL alerts are now available by default for workspaces with the compliance security profile enabled
Supports all compliance security profile standards, monitors data and KPIs via scheduled queries.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Strac connector (Beta)
Ingests Strac data-security audit events using a Strac API key.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Behavior changes for continuous jobs and pipelines Coming soon
Configures continuous schedule from pipeline page, wrapping pipeline in a continuous job. Replaces pipeline's built-in continuous setting for new pipelines.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Restrict access to AI Functions with Unity Catalog permissions (Public Preview)
Requires account team enablement, restricts access to task-specific AI Functions.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Excel file format support is now available by default
Supports .xls, .xlsx, and .xlsm files without external libraries.
- REPLACE WHERE flows are now generally available
Replaces full table reprocessing with row-level updates based on a predicate.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Standard performance mode is now supported for materialized view or streaming table refreshes in jobs
Consumes fewer DBUs when Performance optimized setting is off.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Lakeflow Connect row filtering is now generally available
Works like a SQL WHERE clause, applies to initial and incremental updates.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Veeva Vault connector (Beta)
Ingests standard and custom objects from Veeva using OAuth 2.0 M2M auth.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Lakehouse Real-Time (Beta)
Delivers sub-second SQL read queries against Unity Catalog tables. Built for low-latency workloads.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - MATCH_RECOGNIZE is now in Beta
Requires enabling Match Recognize preview in workspace settings.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Run a subset of job tasks with their dependencies
Add + modifier to task key to include dependencies, usable via UI, API, or CLI.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks SQL version 2026.20 is now available in Preview
Adds IP address functions, NEAREST BY join type, and QUALIFY clause, with fixes for MERGE WITH SCHEMA EVOLUTION.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Govern LLMs in Unity Catalog with model services (Beta)
Represents a governed LLM endpoint, sharable across workspaces via Unity Catalog privileges.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - SQL alert task in Lakeflow Jobs is now generally available
Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state for downstream tasks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Metric view parameters are now in Public Preview
binds values at query time, replacing separate views per variant.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Microsoft Dynamics 365 connector (GA)
Ingests CRM and ERP data into Databricks using Azure Synapse Link.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Change the owner of standalone pipeline streaming tables and materialized views
Uses ALTER STREAMING TABLE and ALTER MATERIALIZED VIEW with SET OWNER TO. Applies to standalone pipeline datasets in Databricks SQL.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Data Classification is now available by default for some workspaces with the compliance security profile enabled
Requires compliance security profile and specific controls like HIPAA or HITRUST.
- Standalone pipeline materialized views support expectations
Validates records in materialized views using CONSTRAINT clause. Replaces manual validation in standalone pipelines.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Enable access requests across your Unity Catalog metastore (Public Preview)
Enables requests at metastore level, inherited by all catalogs and schemas.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Square managed ingestion connector (Beta)
Ingests point-of-sale data like payments and orders from Square into Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - The Discover page is now in Public Preview
Helps find Unity Catalog data assets without requiring catalog hierarchy knowledge. Organizes tables and dashboards by business area.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.