Databricks releases, every cloud
- Lakebase snapshots API (Beta)
Manages point-in-time snapshots of project branches, allowing create, get, list, delete, and restore operations.
- JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon
Replaces cluster provisioning, available in Lakeflow Jobs.
- The counter_diff SQL window function is now available
Calculates differences between consecutive cumulative counter values, available in Databricks Runtime 19 and above.
- Window measures on a numeric index column in metric views
Supports unitless offset and ranges on consecutive integer columns, useful for non-calendar periods like fiscal weeks.
- Standard performance mode is now available for one-time runs in the Jobs API
Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.
- Maintenance windows for continuous pipelines
Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Managed tables in Lakeflow pipelines (Beta)
Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.
- Anaplan connector (Beta)
Ingests Anaplan audit trail events and user account records into Databricks.
- Anysphere Organization connector (Beta)
Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.
- Celigo connector (Beta)
Ingests Celigo audit log events into Databricks using an API token.
- Lakebase now supports PCI-DSS and HITRUST in all AWS regions
Requires compliance security profile enabled. Previously limited to us-east-1 region.
- See which chunks support each ai_search answer (Beta)
Added generate_citations option to show supporting chunks.
- time_bucket SQL function aligns timestamps to fixed-width time buckets
Replaces date_trunc for non-calendar units, requires origin and width parameters.
- Environment version 6 is now available
Supports serverless and standard classic compute.
- Lakebase now available in Azure Japan East region (japaneast)
Available in japaneast region, requires Postgres database setup.
- Atlassian Audit Logs connector (Beta)
Ingests Atlassian organization audit log events using an API key.
- Genie Code is now available as a Lakeflow Jobs task (Beta)
Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.
- Anysphere Audit Logs connector (Beta)
Uses Anysphere Admin API to ingest audit-log events, requires Cursor Admin API key.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- LTAP Direct Writes accelerates synced table loads (Beta)
Requires Postgres 17, enabled from Previews page. Writes directly to storage layer.
- Genie Code is now available in the Lakebase project UI
Lets you run multi-step data and AI tasks with natural language input. Available for all Lakebase projects.
- Postgres minor version updates
Updates to 16.15, 17.11, and 18.6, applied on compute restart.
- Verkada connector (Beta)
Ingests Verkada organization audit logs and access users using a Verkada API key.
- Default Python package repositories are GA for Lakeflow pipelines and classic compute
Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.
- Lakebase adds compliance security profile standards on Azure
Supports ISMAP, IRAP, and UK Cyber Essentials Plus on Azure.
- Performance mode now applies to materialized view and streaming table refreshes from dbt tasks
Now applies to dbt tasks, with optional Standard mode for lower costs, increasing latency to 4-6 minutes.
- Lakebase available in four new Azure regions
Added to North Central US, France Central, Germany West Central, and East Asia regions.
- Workiva connector (Beta)
Ingests Workiva audit activity, users, and roles using OAuth2 client credentials.
- Gmail connector in Lakeflow Connect (Beta)
Ingests messages, labels, drafts, filters, and profile data using a Google service account.
- SendGrid connector (Beta)
Ingests SendGrid subuser directory and IP access activity using a parent-account API key.
- Amplitude connector (Beta)
Ingests product analytics event data with metadata from Amplitude.
- Glean connector in Lakeflow Connect (Beta)
Ingests company-wide usage insights using a Glean Client API token.
- REPLACE USING flows for standalone streaming tables (Beta)
Replaces rows matching specified key columns, requires SEQUENCE BY column.
- Lakebase now supports PCI-DSS and HITRUST
Requires compliance security profile, limited to us-east-1 on AWS.
- Notion connector (Beta)
Ingests Notion pages, databases, and users into Databricks.
- Orchestrate continuous pipelines with continuous jobs
Determines execution mode, allows serverless Standard performance mode. Replaces pipeline's built-in continuous setting.
- Change data feed on materialized views (Beta)
Requires Databricks Runtime 18 LTS or above. Enables replication to external destinations.
- REPLACE USING flows for pipelines (Beta)
Replaces rows matching specified key columns, doesn't require change data capture feed or primary key.
- Google Drive connector (GA)
Supports fully managed and custom ingestion pipelines with Spark and SQL APIs.
- NetSuite connector (GA)
Ingests ERP and financial data from Oracle NetSuite into Databricks.
- PagerDuty connector (Beta)
Ingests incident, on-call, service, and audit data from PagerDuty into Databricks.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.