Databricks on Azure
1149 releases that have landed on Azure, newest first.
- Databricks SQL version 2025.20 is now available in Preview
Includes new features and behavioral changes in Preview channel.
- Genie visualization and permissions improvements
Respects SQL sort order by default. Allows CAN MANAGE users to delete Genie Agents.
- Git folders now supports multiple Git credentials per user (Public Preview)
Managed through the UI, supports multiple Git providers.
- Azure China North 3 region: Enhanced infrastructure support
Improves performance and reliability for chinanorth3 region users.
- Cross-platform S3 access now available on workspaces with serverless egress control
Requires network policy update via API. Admins must add cross-cloud S3 locations.
- Bring your own data lineage (Public Preview)
Includes external assets and workflows run outside of Databricks. Requires Unity Catalog.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Dashboard Git integration and workflow improvements
Diff reviews show queries and text across multiple lines, and Genie supports multistatement SQL queries.
- Deletion vectors on Spark Declarative Pipelines on Lakeflow tables now follow workspace settings
Applies to new streaming tables and materialized views, following workspace settings.
- Genie API enhancements and SQL function improvements
Adds list, delete conversations, and delete Genie Agents endpoints. Improves SQL function application to relevant questions.
- New Databricks JDBC Driver is open source
Licensed under Apache 2.0, accepting community contributions.
- File arrival triggers with file events is now generally available
Requires file events enabled on external locations like S3 or Azure storage. Raises trigger limit to 1,000 per workspace.
- MLfLow support for compliance security profile standards
Supports HIPAA, PCI-DSS, and FedRAMP Moderate standards.
- Parse documents using ai_parse_document (Beta)
Extracts structured content from unstructured documents using Databricks Foundation Model APIs.
- Use PDFs in Information Extraction and Custom LLM (Beta)
Converts PDFs to Markdown, storing results in a table for input in Information Extraction and Custom LLM.
- Databricks Runtime 17.0 is GA
Replaces previous runtimes, with end of support dates listed.
- OIDC federation for Databricks-to-open Delta Sharing is generally available
Uses JSON web tokens from recipients' IdP for authentication.
- Custom rate limits for model serving endpoints
Limits apply to overall traffic, users, service principals, or user groups.
- Migrate Spark Declarative Pipelines on Lakeflow pipelines from legacy publishing mode
Replaces single catalog and schema publishing with multi catalog and schema support. Defaults to multi catalog mode after migration.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Sharing managed Iceberg tables in Delta Sharing is in Public Preview
Supports Databricks-to-Databricks and open sharing. Requires adding tables to a share.
- File upload and theme customization features
Uploads files to Unity Catalog from dashboards. Customizes themes with font and color settings.
- Genie filter editing and audit log enhancements
Editable filters refine responses for string columns with entity matching. Audit log adds comment_type field for feedback comments.
- AI documentation for Unity Catalog tables and columns now uses the same model as Databricks Assistant
Uses a Databricks-hosted model, staying available even if Partner-powered AI features are turned off.
- Jobs & Pipelines in the left navigation menu
Replaces Pipelines and Workflows items, unifying their functionality.
- Updates to the outbound control plane public IPs Coming soon
Replaces previous IPs, requires firewall updates by September 26, 2025. Previous IPs still supported.
- Moving streaming tables and materialized views between pipelines is in Public Preview
Supports moving tables created by Spark Declarative Pipelines on Lakeflow.
- Attribute-based access control (ABAC) in Unity Catalog is in Beta
Uses tags and user-defined functions to enforce fine-grained access controls.
- Automatic liquid clustering is now GA
Enables intelligent clustering key selection on Unity Catalog managed tables.
- Dashboard visualization fixes and schedule updates
Fixes tooltip highlighting and table collapse issues. Parameterized schedules are temporarily disabled.
- AI Gateway is now generally available
Streamlines AI model usage and management with features like permission and rate limiting, and payload logging.
- AUTO CDC APIs replace APPLY CHANGES
Supports change data feeds in Spark Declarative Pipelines on Lakeflow. Replaces APPLY CHANGES APIs.
- Convert to Unity Catalog managed table from external table is in Public Preview
Uses ALTER TABLE SET MANAGED command. Requires participating customer status.
- Databricks Jobs is now Lakeflow Jobs
No migration is required.
- Databricks SQL Serverless engine upgrades
Upgrades bring up to 25% lower latency and add Predictive Query Execution and Photon vectorized shuffle.
- DLT is now Spark Declarative Pipelines on Lakeflow
No migration is required.
- Foreign Apache Iceberg tables are in Public Preview
Supports reading Iceberg tables from HMS, Glue, and Snowflake Horizon Catalog. Requires Lakehouse Federation.
- Lakebase, a managed PostgreSQL OLTP database, is in Public Preview
Provides PostgreSQL-compatible storage and compute for transactional workloads.
- Managed Apache Iceberg tables are in Public Preview
Supports read and write from Databricks or external Iceberg engines. Integrates with predictive optimization.
- Microsoft SharePoint connector (Beta)
ingests SharePoint data into Databricks via API-based pipeline creation.
- Monitor and revoke personal access tokens in your account (GA)
Account admins can monitor and revoke PATs in the account console, replacing manual tracking methods, and OAuth tokens are recommended instead.
- Deployment jobs (Public Preview)
Automates tasks for new model versions, integrating with Unity Catalog models and Lakeflow Jobs.