Databricks releases, every cloud
- Unused OAuth client secrets are automatically deleted after 90 days
Deletes unused secrets after 90 days, create new if still needed.
- JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon
Replaces cluster provisioning, available in Lakeflow Jobs.
- Standard performance mode is now available for one-time runs in the Jobs API
Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.
- Maintenance windows for continuous pipelines
Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.
- Managed tables in Lakeflow pipelines (Beta)
Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.
- Anaplan connector (Beta)
Ingests Anaplan audit trail events and user account records into Databricks.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Anysphere Organization connector (Beta)
Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.
- Celigo connector (Beta)
Ingests Celigo audit log events into Databricks using an API token.
- External secrets in Unity Catalog (Beta)
Connects Unity Catalog schema to AWS Secrets Manager, appearing as read-only objects.
- Restrict service principal OAuth secrets to specific API scopes
Restricts OAuth secrets to specific API scopes like sql or jobs, limiting leaked secret impact.
- Atlassian Audit Logs connector (Beta)
Ingests Atlassian organization audit log events using an API key.
- Genie Code is now available as a Lakeflow Jobs task (Beta)
Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.
- Anysphere Audit Logs connector (Beta)
Uses Anysphere Admin API to ingest audit-log events, requires Cursor Admin API key.
- Verkada connector (Beta)
Ingests Verkada organization audit logs and access users using a Verkada API key.
- Default Python package repositories are GA for Lakeflow pipelines and classic compute
Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.
- Performance mode now applies to materialized view and streaming table refreshes from dbt tasks
Now applies to dbt tasks, with optional Standard mode for lower costs, increasing latency to 4-6 minutes.
- Workiva connector (Beta)
Ingests Workiva audit activity, users, and roles using OAuth2 client credentials.
- Block or redact sensitive data in requests and responses
Detects SSNs, credit cards, and phone numbers using regex and checksums. Requires Enhanced Unity Gateway preview.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Cross-workspace access for serverless (Beta)
Controls serverless network traffic between workspaces with ingress and egress rules.
- Gmail connector in Lakeflow Connect (Beta)
Ingests messages, labels, drafts, filters, and profile data using a Google service account.
- SendGrid connector (Beta)
Ingests SendGrid subuser directory and IP access activity using a parent-account API key.
- Amplitude connector (Beta)
Ingests product analytics event data with metadata from Amplitude.
- Glean connector in Lakeflow Connect (Beta)
Ingests company-wide usage insights using a Glean Client API token.
- ABAC GRANT policies now cover Unity Gateway resource types (Beta)
Supports model services, model provider services, MCP services, and agent services, allowing tag-based access.
- REPLACE USING flows for standalone streaming tables (Beta)
Replaces rows matching specified key columns, requires SEQUENCE BY column.
- Notion connector (Beta)
Ingests Notion pages, databases, and users into Databricks.
- Orchestrate continuous pipelines with continuous jobs
Determines execution mode, allows serverless Standard performance mode. Replaces pipeline's built-in continuous setting.
- READ METADATA privilege is GA
Provides read-only visibility into security-sensitive metadata, including privilege grants and ABAC policies.
- Change data feed on materialized views (Beta)
Requires Databricks Runtime 18 LTS or above. Enables replication to external destinations.
- Genie One is now available in Google Sheets
Queries governed data in natural language, importing results as native rows and columns.
- Genie One is now available in Microsoft Excel
Queries governed data in natural language, importing results as native rows and columns.
- REPLACE USING flows for pipelines (Beta)
Replaces rows matching specified key columns, doesn't require change data capture feed or primary key.
- Google Drive connector (GA)
Supports fully managed and custom ingestion pipelines with Spark and SQL APIs.
- NetSuite connector (GA)
Ingests ERP and financial data from Oracle NetSuite into Databricks.
- PagerDuty connector (Beta)
Ingests incident, on-call, service, and audit data from PagerDuty into Databricks.
- SharePoint connector (GA)
Includes managed and standard connectors for ingestion pipelines.
- Automatic cost attribution for materialized views and streaming tables in Databricks SQL
Inherits custom tags from enclosing SQL warehouse environment for billing.
- OpenAI connector (Beta)
Uses OpenAI Organization Admin API to ingest admin data, authenticates with OpenAI Admin API key.
- Unit testing for pipelines (Beta)
Validates Python and SQL transformations against mock data. Requires Lakeflow Pipelines Editor.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Override the REPLACE WHERE predicate for a single refresh
Adds a WHERE clause to the REFRESH STREAMING TABLE command. Applies to standalone streaming tables with FLOW REPLACE WHERE clause.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.