Databricks releases, every cloud
- Session restore for serverless jobs is in Public Preview
Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.
- Zerobus Ingest into default storage is now in Public Preview
Supports tables backed by default storage, requires Lakeflow Connect setup.
- Pipeline events system table is in Beta
Records Lakeflow pipeline event logs, capturing lifecycle transitions and errors, for querying and building alerts.
- C++ SDK for the Zerobus Ingest connector is now available in Beta
Supports JSON and Protocol Buffers for ingesting into Unity Catalog Delta tables.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Reddit Ads connector is now available in Beta
Ingests advertising campaign data and performance metrics from Reddit Ads into Databricks.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Thinking Machine Labs Inkling now available as a Databricks-hosted model in Public Preview
Supports text and image inputs with a 1 million token context window. Access via Foundation Model APIs.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Restrict access to AI Functions with Unity Catalog permissions (Public Preview)
Requires account team enablement, restricts access to task-specific AI Functions.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Managed agent memory is in Beta
Stores memory in Unity Catalog memory stores, accessed through REST API.
- Omnigent coding agent meta-harness is now in Beta
Wraps coding agents like Claude Code and Codex with a common platform. Swap runtimes with one line of configuration.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - External data access for pipeline streaming tables and materialized views (Public Preview)
Enables external Delta and Iceberg clients to read data without copying. Uses Unity Catalog and Iceberg catalog REST APIs.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Real-time mode in Spark Declarative Pipelines on Lakeflow, and the update_flow API are now available (Public Preview)
Achieves end-to-end latency as low as 5ms, uses update output mode.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Spark Declarative Pipelines on Lakeflow parameters are now in Beta
Define key-value pairs at pipeline level, referenced in SQL using named parameter syntax.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - SQL alert task in Lakeflow Jobs is now in Public Preview
Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state as output.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Alibaba Cloud Qwen3.5 122B A10B now available as a Databricks-hosted model in Public Preview
Accessible via Foundation Model APIs, available in Public Preview.
- Lakeflow Designer is now in Public Preview
Offers drag-and-drop canvas and natural language for building data workflows.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Query-based connectors for Lakeflow Connect (Public Preview)
Ingests data from databases using a cursor column, supporting Oracle, Teradata, and others.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - ai_classify and ai_extract now support v2 signatures (Public Preview)
Supports improved quality and performance with native composability with ai_parse_document.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Classification and Information Extraction are in Public Preview
Built on v2 signatures of ai_classify and ai_extract, they provide visual UIs for document analysis.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- JAR tasks on serverless compute is now in Public Preview
Allows running JAR jobs without a cluster.
- Qwen3-Embedding-0.6B now available in Public Preview as a Databricks-hosted model
Accessible via Foundation Model APIs on a pay-per-token basis.
- Configure default Python package repositories for Spark Declarative Pipelines on Lakeflow (Public Preview)
Allows installation from internal Python repositories without index-url or extra-index-url. Requires workspace admin configuration.
- Managed MCP servers is now Public Preview
Allows AI agents to connect to Databricks resources and external APIs.
- MySQL connector in Lakeflow Connect (Public Preview)
Enables incremental data ingestion from various MySQL databases. Requires access request through account team.
- PostgreSQL connector in Lakeflow Connect (Public Preview)
Enables incremental data ingestion from various PostgreSQL databases. Requires configuration.
- Microsoft Dynamics 365 connector (Public Preview)
Ingests data from Dynamics 365 apps into Databricks. Requires Lakeflow Connect.
- NetSuite connector (Public Preview)
Ingests data from NetSuite2.com via API, CLI, or notebook.
- ForEachBatch for Spark Declarative Pipelines on Lakeflow is available (Public Preview)
Allows processing streams as micro-batches in Python. Requires Lakeflow setup.
- SFTP connector (Public Preview)
Extends Auto Loader to ingest files from SFTP servers.
- Zerobus Ingest connector in Lakeflow Connect (Public Preview)
Enables record-by-record ingestion into Delta tables via gRPC API.
- Alibaba Cloud Qwen3-Next Instruct now available in Beta
Supports 80B A3B Instruct in us-west-2 and ap-northeast-1 regions via pay-per-token APIs.
- Unified runs list (Public Preview)
Combines job and pipeline runs into one list.
- Lakeflow Pipelines Editor is now in public preview
Replaces multi-file editor, edits pipelines as files in asset browser, defaults to Python and SQL code.
- Discover files in Auto Loader efficiently using file events without enrollment (Public Preview)
Requires file events enabled on external locations.
- Spark Declarative Pipelines on Lakeflow now supports stream progress metrics in Public Preview
Supports querying event log for stream progress metrics.
- AI agents: Authorize on-behalf-of-user Public Preview
Lets agents act as the Databricks user who runs the query for added security.
- Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is rolled back to Public Preview
Reverts migration feature to Public Preview due to issues. Requires re-enabling default publishing mode in pipelines.
- External MCP servers are in Beta
Enables agent access to external tools, requires connecting to Model Context Protocol servers.
- Spark Declarative Pipelines on Lakeflow template in bundles in the workspace (Public Preview)
Creates ETL pipelines in workspace bundles using Lakeflow template. Requires New ETL pipeline setup.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.