Databricks releases, every cloud
- Unused OAuth client secrets are automatically deleted after 90 days
Deletes unused secrets after 90 days, create new if still needed.
- JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon
Replaces cluster provisioning, available in Lakeflow Jobs.
- The counter_diff SQL window function is now available
Calculates differences between consecutive cumulative counter values, available in Databricks Runtime 19 and above.
- Window measures on a numeric index column in metric views
Supports unitless offset and ranges on consecutive integer columns, useful for non-calendar periods like fiscal weeks.
- Standard performance mode is now available for one-time runs in the Jobs API
Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.
- Maintenance windows for continuous pipelines
Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Managed tables in Lakeflow pipelines (Beta)
Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.
- Anaplan connector (Beta)
Ingests Anaplan audit trail events and user account records into Databricks.
- Anysphere Organization connector (Beta)
Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.
- Celigo connector (Beta)
Ingests Celigo audit log events into Databricks using an API token.
- External secrets in Unity Catalog (Beta)
Connects Unity Catalog schema to AWS Secrets Manager, appearing as read-only objects.
- See which chunks support each ai_search answer (Beta)
Added generate_citations option to show supporting chunks.
- time_bucket SQL function aligns timestamps to fixed-width time buckets
Replaces date_trunc for non-calendar units, requires origin and width parameters.
- Compliance security profile will enforce Azure Virtual Network encryption Coming soon
Enforces Azure Virtual Network encryption on workspaces starting February 1, 2027.
- Restrict service principal OAuth secrets to specific API scopes
Restricts OAuth secrets to specific API scopes like sql or jobs, limiting leaked secret impact.
- Atlassian Audit Logs connector (Beta)
Ingests Atlassian organization audit log events using an API key.
- Genie Code is now available as a Lakeflow Jobs task (Beta)
Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.
- Anysphere Audit Logs connector (Beta)
Uses Anysphere Admin API to ingest audit-log events, requires Cursor Admin API key.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Verkada connector (Beta)
Ingests Verkada organization audit logs and access users using a Verkada API key.
- Inbound Private Service Connect for performance-intensive services (Beta)
Enables private connectivity to services like Zerobus Ingest and Lakebase Autoscaling on Google Cloud.
- Default Python package repositories are GA for Lakeflow pipelines and classic compute
Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.
- Performance mode now applies to materialized view and streaming table refreshes from dbt tasks
Now applies to dbt tasks, with optional Standard mode for lower costs, increasing latency to 4-6 minutes.
- Workiva connector (Beta)
Ingests Workiva audit activity, users, and roles using OAuth2 client credentials.
- Block or redact sensitive data in requests and responses
Detects SSNs, credit cards, and phone numbers using regex and checksums. Requires Enhanced Unity Gateway preview.
- Cross-workspace access for serverless (Beta)
Controls serverless network traffic between workspaces with ingress and egress rules.
- Custom URL access to workspaces over inbound Private Link (Beta)
Uses general_access private endpoint, serves workspaces and account-level resources across regions.
- Gmail connector in Lakeflow Connect (Beta)
Ingests messages, labels, drafts, filters, and profile data using a Google service account.
- SendGrid connector (Beta)
Ingests SendGrid subuser directory and IP access activity using a parent-account API key.
- Amplitude connector (Beta)
Ingests product analytics event data with metadata from Amplitude.
- Glean connector in Lakeflow Connect (Beta)
Ingests company-wide usage insights using a Glean Client API token.
- ABAC GRANT policies now cover Unity Gateway resource types (Beta)
Supports model services, model provider services, MCP services, and agent services, allowing tag-based access.
- REPLACE USING flows for standalone streaming tables (Beta)
Replaces rows matching specified key columns, requires SEQUENCE BY column.
- Notion connector (Beta)
Ingests Notion pages, databases, and users into Databricks.
- Orchestrate continuous pipelines with continuous jobs
Determines execution mode, allows serverless Standard performance mode. Replaces pipeline's built-in continuous setting.
- READ METADATA privilege is GA
Provides read-only visibility into security-sensitive metadata, including privilege grants and ABAC policies.
- Change data feed on materialized views (Beta)
Requires Databricks Runtime 18 LTS or above. Enables replication to external destinations.
- REPLACE USING flows for pipelines (Beta)
Replaces rows matching specified key columns, doesn't require change data capture feed or primary key.
- Google Drive connector (GA)
Supports fully managed and custom ingestion pipelines with Spark and SQL APIs.
- NetSuite connector (GA)
Ingests ERP and financial data from Oracle NetSuite into Databricks.
- PagerDuty connector (Beta)
Ingests incident, on-call, service, and audit data from PagerDuty into Databricks.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.