Databricks releases, every cloud
- Environment variables for serverless jobs are in Beta
Requires workspace admin to enable from Previews page.
- Scala and Java UDFs in Unity Catalog are now generally available
Reuses existing JVM logic, offers better performance than Python UDFs.
- Object metadata column is now in Public Preview
Exposes object properties like MIME type and tags, available in Databricks Runtime 18.1.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - MySQL integrated CDC pipeline is now in Beta
Replaces separate ingestion gateway, requires single pipeline update.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Parquet v2 for Delta Lake tables is generally available
Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.
- Databricks connector for Power Platform is generally available
Connects Databricks to Power Platform services like Power BI and Power Apps. Requires Databricks account and Power Platform license.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- AUTO CDC flows for streaming tables in Databricks SQL are generally available
Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Use OAuth to authenticate Databricks connections in Power Platform
Replaces personal access tokens, requires setup in Power Platform.
- Auto time-to-live for automatic row deletion is generally available
Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.
- Converting a partitioned table to liquid clustering is generally available
Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.
- Lakehouse Replay (Beta)
Automatically replays serverless workloads against upcoming runtime releases. Requires no setup.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Power BI connections will transition to ADBC Coming soon
Replaces ODBC, requires manual update for existing connections.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Spark Declarative Pipelines on Lakeflow updates are retained for 60 days
Retention period increased from 30 to 60 days, applying to UI and REST API updates.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - SQL alert task for jobs (Beta)
Evaluates SQL alerts as part of workflows, enabling automated condition checks and notifications.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Add Azure Databricks Genie MCP server to Azure AI Foundry (Public Preview)
Enables AI agents to connect to Genie Agents and query data. Requires Azure AI Foundry setup.
- Connect Genie Agents to Microsoft Copilot Studio (Public Preview)
Requires Managed MCP Servers preview enabled.
- Databricks Connector for Google Sheets offers additional features (Public Preview)
Saves queries within a Google Sheet spreadsheet for easy data refresh and reuse.
- Interact with Azure Databricks jobs in a Power Automate flow (Public Preview)
Adds Azure Databricks job action to Power Automate flows. Requires adding the action to a flow.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Azure Databricks connector in Microsoft Power Platform is now GA
Replaces beta version, requires Azure Databricks account.
- Power BI Azure Databricks connector supports M2M OAuth
Replaces personal access tokens for service principals with Client credentials authentication.
- Power BI Databricks connector supports M2M OAuth
Replaces personal access tokens for service principals with Client credentials authentication.
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.