Databricks on GCP
1097 releases that have landed on GCP, newest first.
- Serverless jobs and pipelines configured in the UI are now performance optimized by default
aligns UI with existing API, Terraform, and SDK defaults.
- Google Analytics Raw Data connector GA
Enables ingestion of raw Google Analytics data into Databricks, requires Google Analytics 4 and Google BigQuery setup.
- Python custom data sources can be used with Spark Declarative Pipelines on Lakeflow
Supports Python custom data sources and sinks in pipeline definitions.
- Spark Declarative Pipelines on Lakeflow now supports stream progress metrics in Public Preview
Supports querying event log for stream progress metrics.
- The SAP Business Data Cloud (BDC) Connector for Databricks is generally available
Enables secure data sharing between SAP BDC and Unity Catalog-enabled Databricks workspaces.
- Databricks Apps support for Genie resources
Enables natural language querying over curated datasets, requires adding a Genie Space as an app resource.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Databricks Runtime maintenance update
Includes bug fixes, security patches, and performance improvements.
- Databricks connector in Microsoft Power Platform is in Public Preview
Enables building canvas apps and flows with Databricks data. Requires creating a Databricks connection in Power Platform.
- MLflow metadata is now available in system tables (Public Preview)
Exposes MLflow tracking data via SQL, enabling custom dashboards and queries.
- AI/BI dashboard active filter bar and visualization improvements
Shows all active filters on a dashboard, including global and page-level filters. Supports min and max aggregations for date fields.
- New Genie API endpoints and improved benchmarks
New endpoints manage conversations, replacing value sampling with prompt matching.
- Databricks Assistant Agent mode: Data Science Agent is in Beta
Orchestrates multi-step workflows from a single prompt, building entire notebooks for tasks like EDA and machine learning.
- AI agents: Authorize on-behalf-of-user Public Preview
Lets agents act as the Databricks user who runs the query for added security.
- C5 compliance controls
Meets German Federal Office for Information Security standard, replacing none, requires setup changes.
- Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is rolled back to Public Preview
Reverts migration feature to Public Preview due to issues. Requires re-enabling default publishing mode in pipelines.
- Tables backed by default storage can be Delta shared to any recipient (Beta)
Excludes tables with partitioning enabled, works with classic compute recipients.
- SQL Server connector supports SCD type 2
Maintains a history of changes, rather than overwriting outdated records.
- Account SCIM 2.0 updates
Requires quoted filter values, drops member info from Groups endpoint.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Admins can now manage a workspace's serverless base environments (Public Preview)
Defines custom environment specs for serverless notebooks, allows setting a default for new notebooks.
- Dashboard external embedding Public Preview and new custom calculations functions
Adds ln, log, log10, and round functions, increases custom calculations limit to 200 per dataset.
- Default warehouse setting is now available in Beta
Applied across SQL editor, AI/BI dashboards, and other tools, with optional user override.
- External MCP servers are in Beta
Enables agent access to external tools, requires connecting to Model Context Protocol servers.
- Genie follow-up questions and fixes
Fixes cloning large spaces and CSV downloads on Windows.
- Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is now GA
Replaces legacy single-catalog publishing with multi-catalog support.
- Track and navigate notebook runs with the new cell execution minimap
Appears in the right margin, shows cell execution states, and allows clicking to jump to a cell.
- Databricks Runtime 17.2 and Databricks Runtime 17.2 ML are in Beta
Includes SQL and API enhancements, reliability and performance improvements.
- Governed tags are Public Preview
Enforce consistent tagging with admin-defined keys and values.
- Microsoft SQL Server connector GA
Replaces manual ingestion scripts, requires Lakeflow Connect setup.
- New INSERT REPLACE commands (GA)
Available for Databricks Runtime 17.2, replacing existing INSERT OVERWRITE syntax.
- New table property to control Delta table compression
Sets compression codec for Delta tables, applies to future writes.
- OAuth token federation is now GA
Enables secure API access using identity provider tokens, configurable via UI, CLI, or REST API.
- Automatic liquid clustering is now available for Spark Declarative Pipelines on Lakeflow
Uses CLUSTER BY AUTO to optimize query performance. Requires Spark Declarative Pipelines on Lakeflow.
- Enhanced autocomplete for complex data types in notebooks
Supports structs, maps, and arrays in SQL cells, and provides column recommendations for CTEs using SELECT *.
- Salesforce Data Cloud File Sharing connector GA
Replaces manual uploads, integrates with Lakehouse Federation.
- Updates for customer-managed VPC workspaces (Public Preview)
Adds Private Service Connect conversion and network config changes.
- Dashboard sorting and formatting improvements
Sorting now works on temporal categorical axes. Numeric values can be formatted as Bytes.
- Databricks Assistant integrated with compute
Creates compute resources, pools, and policies, and answers questions about them. Available on some compute pages.
- Databricks SQL version 2025.25 is rolling out in Current
Rolls out from August 20th to August 28th, 2025.
- Genie SQL validation and space management
Validates SQL join relationships and fixes space cloning issue. Flags errors in join statements.
- Serverless compute runtime updated to 17.1
corresponds to Databricks Runtime 17.1, see release notes for details.