Databricks on GCP
1104 releases that have landed on GCP, newest first.
- Databricks SQL version 2025.20 is now available in Preview
Includes new features and behavioral changes in Preview channel.
- Genie visualization and permissions improvements
Respects SQL sort order by default. Allows CAN MANAGE users to delete Genie Agents.
- Git folders now supports multiple Git credentials per user (Public Preview)
Managed through the UI, supports multiple Git providers.
- Bring your own data lineage (Public Preview)
Includes external assets and workflows run outside of Databricks. Requires Unity Catalog.
- Manage network policies for serverless egress control (Public Preview)
Enforces outbound network policies for SQL warehouses and model serving endpoints, allowing domain and storage account allowlisting.
- Dashboard Git integration and workflow improvements
Diff reviews show queries and text across multiple lines, and Genie supports multistatement SQL queries.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Genie API enhancements and SQL function improvements
Adds list, delete conversations, and delete Genie Agents endpoints. Improves SQL function application to relevant questions.
- New Databricks JDBC Driver is open source
Licensed under Apache 2.0, accepting community contributions.
- File arrival triggers with file events is now generally available
Requires file events enabled on external locations like S3 or Azure storage. Raises trigger limit to 1,000 per workspace.
- MLfLow support for compliance security profile standards
Supports HIPAA, PCI-DSS, and FedRAMP Moderate standards.
- Parse documents using ai_parse_document (Beta)
Extracts structured content from unstructured documents using Databricks Foundation Model APIs.
- Databricks Runtime 17.0 is GA
Replaces previous runtimes, with end of support dates listed.
- OIDC federation for Databricks-to-open Delta Sharing is generally available
Uses JSON web tokens from recipients' IdP for authentication.
- Serverless compute is now available in us-west4
Supports notebooks, workflows, and Lakeflow pipelines.
- Custom rate limits for model serving endpoints
Limits apply to overall traffic, users, service principals, or user groups.
- Migrate Spark Declarative Pipelines on Lakeflow pipelines from legacy publishing mode
Replaces single catalog and schema publishing with multi catalog and schema support. Defaults to multi catalog mode after migration.
- Sharing managed Iceberg tables in Delta Sharing is in Public Preview
Supports Databricks-to-Databricks and open sharing. Requires adding tables to a share.
- Configure a pool's availability zone using the Databricks UI
Replaces API method, available in Databricks UI now.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- File upload and theme customization features
Uploads files to Unity Catalog from dashboards. Customizes themes with font and color settings.
- Genie filter editing and audit log enhancements
Editable filters refine responses for string columns with entity matching. Audit log adds comment_type field for feedback comments.
- AI documentation for Unity Catalog tables and columns now uses the same model as Databricks Assistant
Uses a Databricks-hosted model, staying available even if Partner-powered AI features are turned off.
- Jobs & Pipelines in the left navigation menu
Replaces Pipelines and Workflows items, unifying their functionality.
- Moving streaming tables and materialized views between pipelines is in Public Preview
Supports moving tables created by Spark Declarative Pipelines on Lakeflow.
- Attribute-based access control (ABAC) in Unity Catalog is in Beta
Uses tags and user-defined functions to enforce fine-grained access controls.
- Automatic liquid clustering is now GA
Enables intelligent clustering key selection on Unity Catalog managed tables.
- Dashboard visualization fixes and schedule updates
Fixes tooltip highlighting and table collapse issues. Parameterized schedules are temporarily disabled.
- AI Gateway is now generally available
Streamlines AI model usage and management with features like permission and rate limiting, and payload logging.
- AUTO CDC APIs replace APPLY CHANGES
Supports change data feeds in Spark Declarative Pipelines on Lakeflow. Replaces APPLY CHANGES APIs.
- Convert to Unity Catalog managed table from external table is in Public Preview
Uses ALTER TABLE SET MANAGED command. Requires participating customer status.
- Databricks Jobs is now Lakeflow Jobs
No migration is required.
- Databricks SQL Serverless engine upgrades
Upgrades bring up to 25% lower latency and add Predictive Query Execution and Photon vectorized shuffle.
- DLT is now Spark Declarative Pipelines on Lakeflow
No migration is required.
- Foreign Apache Iceberg tables are in Public Preview
Supports reading Iceberg tables from HMS, Glue, and Snowflake Horizon Catalog. Requires Lakehouse Federation.
- Managed Apache Iceberg tables are in Public Preview
Supports read and write from Databricks or external Iceberg engines. Integrates with predictive optimization.
- Microsoft SharePoint connector (Beta)
ingests SharePoint data into Databricks via API-based pipeline creation.
- Monitor and revoke personal access tokens in your account (GA)
Account admins can monitor and revoke PATs in the account console, replacing manual tracking methods, and OAuth tokens are recommended instead.
- Deployment jobs (Public Preview)
Automates tasks for new model versions, integrating with Unity Catalog models and Lakeflow Jobs.
- MLflow 3.0 is generally available
Delivers state-of-the-art experiment tracking and performance evaluation for machine learning models.
- Model Context Protocol (MCP) for AI agents is in Beta
Lets AI agents access tools and data via a consistent interface. Supports Databricks-hosted or custom servers.
- Serverless performance targets is now GA
Enables faster startup and execution time when performance optimized setting is used.