Databricks on AWS
1201 releases that have landed on AWS, newest first.
- JAR tasks are now supported on serverless compute
Run JAR jobs without a cluster.
- TISAX compliance controls
Enhances workspace compliance based on ISO/IEC 27001 and VDA ISA.
- Improved notebook debugger experience
Supports multi-file debugging, stepping into functions across files.
- Salesforce ingestion connector supports history tracking (SCD type 2)
Enables history tracking, overwriting default SCD type 1 behavior.
- Skip cells when running notebooks
Adds %skip magic command to exclude cells from runs.
- Dashboard visualization, pivot table, and authoring improvements
Adds Slack channel subscriptions, Top N scroll bar on mouseover, and export to materialized view.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Databricks SQL version 2025.35 is now available in Preview
Adds EXECUTE IMMEDIATE constant expressions and LIMIT ALL for recursive CTEs.
- Genie thinking steps and benchmark error resolution
Explains SQL logic in plain language. Replaces technical explanations in Genie Space, now Genie Agent.
- Lakebase (Beta) now available
Adds autoscaling and database branching on AWS, separate from Public Preview.
- Feedback model deprecated for AI agents
Replaced by log_feedback API in MLflow 3.
- New compute policy form is now generally available
Allows admins to configure policies using dropdown menus, no syntax required.
- Request logs and assessment logs tables deprecated
Replaced by MLflow 3 for real-time tracing, stops populating November 15, 2025.
- Supervisor Agent now supports Unity Catalog functions and external MCP servers
Delegates tasks to Unity Catalog functions and external MCP servers.
- OpenAI GPT 5 models are now generally available in Mosaic AI Model Serving
Includes GPT-5 mini and nano models.
- Gemini 2.5 Pro and Flash models now supported on pay-per-token endpoints
Supports pay-per-token endpoints and Function calling.
- Serverless compute has been updated to version 17.3
Updated from version 17.2, requires no configuration changes.
- Configure compute to use AWS Capacity Blocks
Replaces on-demand instances, requires AWS account setup.
- ai_parse_document (Public Preview)
Extracts information from documents, available for testing.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Dashboard publishing, scheduling, and field management improvements
Notify viewers is off by default. Custom calculations support over 170 functions.
- Databricks JDBC Driver 2.7.5
Adds Kerberos support with proxy connections, fixes issues with complex queries and Unity Catalog ingestion.
- Genie benchmark scaling and SQL function support
Maximum benchmarks per Genie Agent increased to 500. Supports Unity Catalog SQL functions as answers.
- Zerobus Ingest connector in Lakeflow Connect (Public Preview)
Enables record-by-record ingestion into Delta tables via gRPC API.
- Alibaba Cloud Qwen3-Next Instruct now available in Beta
Supports 80B A3B Instruct in us-west-2 and ap-northeast-1 regions via pay-per-token APIs.
- Column drop behavior updated
Fails if column has governed tags, requires removing tags first.
- Databricks Runtime 17.3 LTS is now GA
Replaces 7.3 LTS, requires Databricks account.
- Compatibility Mode (Public Preview)
Enables external clients like Amazon Athena to read tables without sacrificing Databricks performance. Refreshes up to near real-time.
- Databricks Runtime maintenance updates (10/21)
Includes bug fixes, security patches, and performance improvements.
- Zstd is now the default compression for new managed tables
Replaces Snappy compression, applies to Databricks Runtime 16.0 and above.
- New alert editing experience
Replaces old editor with a multi-tab editor for unified workflow.
- Unified runs list (Public Preview)
Combines job and pipeline runs into one list.
- Databricks Connector for Google Sheets offers additional features (Public Preview)
Saves queries within a Google Sheet spreadsheet for easy data refresh and reuse.
- Dashboard and Genie Agents tagging (Public Preview)
Adds organization and automation via API, replaces manual tracking.
- Dashboard pivot tables, gridlines, and drill-through enhancements
Supports contains, startswith, endswith functions in pivot tables. Gridlines can be toggled on and off in charts.
- Declarative Automation Bundles in the workspace is GA
Allows collaborative editing and deployment of bundle updates through the UI.
- Genie API updates, benchmark explanations, and JOIN improvements
JOIN relationships are now sortable, Genie API endpoints move from Beta to Public Preview.
- Jobs can now be triggered on source table update
Triggers require Databricks Runtime 7.0 or later.
- Create backfill job runs
Triggers job runs to load past data, useful for repairing processing failures.
- Data Classification (Public Preview)
Supports all catalog types, consolidates results into a system table.
- Improved autoscaling behavior for Mosaic AI Model Serving
Ignores brief traffic surges, scaling on sustained load increases. Reduces unnecessary concurrency scaling.
- Multimodal support is now available
Supports real-time and batch inference workloads for foundation models.