Databricks releases, every cloud
- Lakebase Search is generally available
Adds scalable vector and keyword search to Lakebase projects via Postgres extensions.
- Lakebase snapshots API (Beta)
Manages point-in-time snapshots of project branches, allowing create, get, list, delete, and restore operations.
- JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon
Replaces cluster provisioning, available in Lakeflow Jobs.
- The counter_diff SQL window function is now available
Calculates differences between consecutive cumulative counter values, available in Databricks Runtime 19 and above.
- Window measures on a numeric index column in metric views
Supports unitless offset and ranges on consecutive integer columns, useful for non-calendar periods like fiscal weeks.
- Session restore for serverless jobs is in Public Preview
Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Standard performance mode is now available for one-time runs in the Jobs API
Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.
- Maintenance windows for continuous pipelines
Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.
- Managed tables in Lakeflow pipelines (Beta)
Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.
- The Azure Databricks Excel Add-in is now generally available
Connects Excel to Azure Databricks workspace for querying and data import. Enables Live query for pivot tables.
- The Databricks Excel Add-in is now generally available
Connects Excel to Databricks workspace for querying and data import. Enables live query for pivot tables.
- Anaplan connector (Beta)
Ingests Anaplan audit trail events and user account records into Databricks.
- Anysphere Organization connector (Beta)
Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.
- Celigo connector (Beta)
Ingests Celigo audit log events into Databricks using an API token.
- Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon
Replaces full snapshot default, improving performance and reducing cost.
- Lakebase now supports PCI-DSS and HITRUST in all AWS regions
Requires compliance security profile enabled. Previously limited to us-east-1 region.
- See which chunks support each ai_search answer (Beta)
Added generate_citations option to show supporting chunks.
- time_bucket SQL function aligns timestamps to fixed-width time buckets
Replaces date_trunc for non-calendar units, requires origin and width parameters.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Zerobus Ingest into default storage is now in Public Preview
Supports tables backed by default storage, requires Lakeflow Connect setup.
- Lakebase now available in Azure Japan East region (japaneast)
Available in japaneast region, requires Postgres database setup.
- Apache Arrow support for Zerobus Ingest is now generally available
Replaces JSON and Avro formats, requires Lakeflow Connect.
- Pipeline events system table is in Beta
Records Lakeflow pipeline event logs, capturing lifecycle transitions and errors, for querying and building alerts.
- Atlassian Audit Logs connector (Beta)
Ingests Atlassian organization audit log events using an API key.
- Genie Code for AI Runtime (Public Preview)
Generates distributed training code and resolves environment issues. Requires AI Runtime.
- Genie Code is now available as a Lakeflow Jobs task (Beta)
Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.
- Zerobus Ingest into streaming tables is now generally available
Works like writing to a managed Delta table with same limits and quotas.
- Anysphere Audit Logs connector (Beta)
Uses Anysphere Admin API to ingest audit-log events, requires Cursor Admin API key.
- LTAP Direct Writes accelerates synced table loads (Beta)
Requires Postgres 17, enabled from Previews page. Writes directly to storage layer.
- Connect to the Databricks Genie app in Microsoft Teams with your workspace URL (Public Preview)
Replaces server hostname with workspace URL for connection.
- Genie Code is now available in the Lakebase project UI
Lets you run multi-step data and AI tasks with natural language input. Available for all Lakebase projects.
- Postgres minor version updates
Updates to 16.15, 17.11, and 18.6, applied on compute restart.
- Verkada connector (Beta)
Ingests Verkada organization audit logs and access users using a Verkada API key.
- Default Python package repositories are GA for Lakeflow pipelines and classic compute
Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.
- Lakebase adds compliance security profile standards on Azure
Supports ISMAP, IRAP, and UK Cyber Essentials Plus on Azure.
- Performance mode now applies to materialized view and streaming table refreshes from dbt tasks
Now applies to dbt tasks, with optional Standard mode for lower costs, increasing latency to 4-6 minutes.
- Salesforce connector mTLS authentication is now generally available
Replaces OAuth client credentials flow for API-only users, requires client certificates.
- Lakebase available in four new Azure regions
Added to North Central US, France Central, Germany West Central, and East Asia regions.
- Lakebase Postgres APIs are now generally available
Supports operations for projects, branches, and databases through REST API, CLI, and SDKs.
- Workiva connector (Beta)
Ingests Workiva audit activity, users, and roles using OAuth2 client credentials.
- Gmail connector in Lakeflow Connect (Beta)
Ingests messages, labels, drafts, filters, and profile data using a Google service account.
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.