Databricks on AWS
1201 releases that have landed on AWS, newest first.
- New table property to control Delta table compression
Sets compression codec for Delta tables, applies to future writes.
- OAuth token federation is now GA
Enables secure API access using identity provider tokens, configurable via UI, CLI, or REST API.
- Automatic liquid clustering is now available for Spark Declarative Pipelines on Lakeflow
Uses CLUSTER BY AUTO to optimize query performance. Requires Spark Declarative Pipelines on Lakeflow.
- Budget policy support for Lakebase database instances and synced tables (Public Preview)
Tags database instances and synced tables for billing attribution, also supports custom tags for compute usage.
- Data type mapping update for Lakebase synced tables
Newly created synced tables map TIMESTAMP to TIMESTAMP WITH TIMEZONE. Existing tables still use TIMESTAMP WITHOUT TIMEZONE.
- Expanded region availability for Databricks Apps
Available in ap-northeast-2 and ap-south-1 regions.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Enhanced autocomplete for complex data types in notebooks
Supports structs, maps, and arrays in SQL cells, and provides column recommendations for CTEs using SELECT *.
- Salesforce Data Cloud File Sharing connector GA
Replaces manual uploads, integrates with Lakehouse Federation.
- Dashboard sorting and formatting improvements
Sorting now works on temporal categorical axes. Numeric values can be formatted as Bytes.
- Databricks Assistant integrated with compute
Creates compute resources, pools, and policies, and answers questions about them. Available on some compute pages.
- Databricks SQL version 2025.25 is rolling out in Current
Rolls out from August 20th to August 28th, 2025.
- Declarative Automation Bundles support for Lakebase database resources
Defines Lakebase database catalogs, instances, and synced tables for one-command deployment. Starts instances immediately upon bundle deployment.
- Genie SQL validation and space management
Validates SQL join relationships and fixes space cloning issue. Flags errors in join statements.
- Serverless compute runtime updated to 17.1
corresponds to Databricks Runtime 17.1, see release notes for details.
- Set the run-as user for Spark Declarative Pipelines on Lakeflow
Replaces user accounts with a service principal for automated workloads.
- Mosaic AI Vector Search reranker Public Preview
Improves retrieval quality with reranking, see usage details in query documentation.
- Dashboard table visualization and chart improvements
Adds indicator for hidden calculated measures, fixes transparent headers and pivot table column widths.
- Databricks-hosted models for Assistant are now GA
Available on all cloud platforms at no extra cost.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Databricks SQL version 2025.25 is now available in Preview
Adds recursive common table expressions and spatial SQL expressions.
- Fixed timeout handling for materialized views and streaming tables
New views and tables apply warehouse timeout, existing ones require CREATE OR REFRESH. Default timeout is 2 days.
- Genie interface and file upload enhancements
File uploads are now accessible only to the uploader, with simplified setup for catalog and schema designation.
- New SQL editor is generally available
Provides a unified authoring environment with features like real-time collaboration and enhanced Databricks Assistant integration.
- Spark Declarative Pipelines on Lakeflow template in bundles in the workspace (Public Preview)
Creates ETL pipelines in workspace bundles using Lakeflow template. Requires New ETL pipeline setup.
- Token-based rate limits now available on AI Gateway
Configures rate limits on model serving endpoints, replacing legacy governance settings, and requires configuration updates.
- OpenAI GPT OSS models now support function calling
Supports function and tool calling on Databricks-hosted models.
- OpenAI GPT OSS models now supported on provisioned throughput
Supports GPT OSS 120B and 20B models on provisioned throughput.
- Schedule jobs for Serverless GPU compute workloads
Creates and schedules Serverless GPU jobs via notebook scheduling.
- Serverless GPU compute now supports multinode workloads
Supports distributed training on multiple nodes, requires AI Runtime.
- Column masks now retained when replacing a table
Retains existing column masks if column names match, preventing accidental removal of security policies.
- Databricks Assistant: User and workspace instructions now available
Custom instructions can be added by users or admins, applying to all Assistant experiences.
- Single-node compute on standard access mode is now GA
Allows multiple users to share with full isolation, useful for small jobs.
- Access requests in Unity Catalog (Public Preview)
Sends requests to emails, Slack, or Teams, or internal systems, with optional default email to owners.
- Disable legacy features for new workspaces (Public Preview)
Disables DBFS root, Hive metastore, and runtime versions prior to 13.3 LTS. Applies to new workspaces only.
- Jobs in continuous mode can now have task-level retries for failed tasks
Task-level retries replace job-level retries, require continuous mode.
- Lakebase Public Preview enabled by default
No admin enablement required, can be disabled by admins.
- Serverless workspaces are now Public Preview
Come pre-configured with serverless compute and default storage. Account admins enable in account console.
- Create external Delta tables from third-party clients (Public Preview)
Backed by Delta Lake, works with Apache Spark, see Access Databricks tables from Delta clients.
- Path credential vending (Public Preview)
Grants short-lived credentials to external locations in Unity Catalog metastore.
- ServiceNow connector GA
Replaces manual API configuration, requires Lakeflow Connect setup.
- Use OpenAI GPT OSS models for batch inference and structured outputs
Optimized for AI Functions with batch inference and structured outputs. Supports ai_query().