Databricks on AWS
1201 releases that have landed on AWS, newest first.
- Genie One Public Preview
Replaces traditional UI for business users, enabled from admin console Previews page.
- Databricks Runtime 17.2 is now is now GA
Replaces 7.3 and earlier, requires new cluster creation.
- Delta Sharing on Lakehouse Federation is in Beta
Shares foreign schemas and tables from query federation.
- Discover files in Auto Loader efficiently using file events without enrollment (Public Preview)
Requires file events enabled on external locations.
- Mount Delta shares to an existing shared catalog
Replaces need to create a new catalog for each share, now mounts to existing catalog.
- AI/BI dashboard text widget and performance improvements
Enhanced UI for text formatting and image insertion. Resolves performance slowdowns and page loading issues.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Genie chart fixes and feature enhancements
Fixed thin bars, single-point maps, and increased entity matching limit to 120 columns.
- Serverless jobs and pipelines configured in the UI are now performance optimized by default
aligns UI with existing API, Terraform, and SDK defaults.
- Google Analytics Raw Data connector GA
Enables ingestion of raw Google Analytics data into Databricks, requires Google Analytics 4 and Google BigQuery setup.
- Python custom data sources can be used with Spark Declarative Pipelines on Lakeflow
Supports Python custom data sources and sinks in pipeline definitions.
- Spark Declarative Pipelines on Lakeflow now supports stream progress metrics in Public Preview
Supports querying event log for stream progress metrics.
- The SAP Business Data Cloud (BDC) Connector for Databricks is generally available
Enables secure data sharing between SAP BDC and Unity Catalog-enabled Databricks workspaces.
- Databricks Apps support for Genie resources
Enables natural language querying over curated datasets, requires adding a Genie Space as an app resource.
- Databricks Runtime maintenance update
Includes bug fixes, security patches, and performance improvements.
- Databricks connector in Microsoft Power Platform is in Public Preview
Enables building canvas apps and flows with Databricks data. Requires creating a Databricks connection in Power Platform.
- Databricks Online Feature Stores (Public Preview)
Provides low-latency access to feature data, integrating with Unity Catalog and MLflow.
- MLflow metadata is now available in system tables (Public Preview)
Exposes MLflow tracking data via SQL, enabling custom dashboards and queries.
- Serverless GPU compute now supports H100 accelerators (Beta)
Supports on-demand H100 accelerators for single-node workflows and jobs.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- AI/BI dashboard active filter bar and visualization improvements
Shows all active filters on a dashboard, including global and page-level filters. Supports min and max aggregations for date fields.
- New Genie API endpoints and improved benchmarks
New endpoints manage conversations, replacing value sampling with prompt matching.
- Databricks Assistant Agent mode: Data Science Agent is in Beta
Orchestrates multi-step workflows from a single prompt, building entire notebooks for tasks like EDA and machine learning.
- AI agents: Authorize on-behalf-of-user Public Preview
Lets agents act as the Databricks user who runs the query for added security.
- C5 compliance controls
Meets German Federal Office for Information Security standard, replacing none, requires setup changes.
- Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is rolled back to Public Preview
Reverts migration feature to Public Preview due to issues. Requires re-enabling default publishing mode in pipelines.
- Tables backed by default storage can be Delta shared to any recipient (Beta)
Excludes tables with partitioning enabled, works with classic compute recipients.
- SQL Server connector supports SCD type 2
Maintains a history of changes, rather than overwriting outdated records.
- Account SCIM 2.0 updates
Requires quoted filter values, drops member info from Groups endpoint.
- OLTP Database tab renamed to Lakebase Postgres in Compute section
Used to create and manage Lakebase database instances, replacing OLTP Database tab.
- Admins can now manage a workspace's serverless base environments (Public Preview)
Defines custom environment specs for serverless notebooks, allows setting a default for new notebooks.
- Dashboard external embedding Public Preview and new custom calculations functions
Adds ln, log, log10, and round functions, increases custom calculations limit to 200 per dataset.
- Default warehouse setting is now available in Beta
Applied across SQL editor, AI/BI dashboards, and other tools, with optional user override.
- External MCP servers are in Beta
Enables agent access to external tools, requires connecting to Model Context Protocol servers.
- Genie follow-up questions and fixes
Fixes cloning large spaces and CSV downloads on Windows.
- Lakebase synced tables supports syncing Apache Iceberg and foreign tables in Snapshot mode
Syncs Iceberg and foreign tables in Snapshot mode, requiring a supported Databricks runtime.
- Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is now GA
Replaces legacy single-catalog publishing with multi-catalog support.
- Track and navigate notebook runs with the new cell execution minimap
Appears in the right margin, shows cell execution states, and allows clicking to jump to a cell.
- Databricks Runtime 17.2 and Databricks Runtime 17.2 ML are in Beta
Includes SQL and API enhancements, reliability and performance improvements.
- Governed tags are Public Preview
Enforce consistent tagging with admin-defined keys and values.
- Microsoft SQL Server connector GA
Replaces manual ingestion scripts, requires Lakeflow Connect setup.
- New INSERT REPLACE commands (GA)
Available for Databricks Runtime 17.2, replacing existing INSERT OVERWRITE syntax.