Databricks releases, every cloud
- Lakebase Search is generally available
Adds scalable vector and keyword search to Lakebase projects via Postgres extensions.
- Base environments are now supported on classic compute (Beta)
Manages Python dependencies using Databricks-provided or custom environments.
- Lakebase snapshots API (Beta)
Manages point-in-time snapshots of project branches, allowing create, get, list, delete, and restore operations.
- JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon
Replaces cluster provisioning, available in Lakeflow Jobs.
- The counter_diff SQL window function is now available
Calculates differences between consecutive cumulative counter values, available in Databricks Runtime 19 and above.
- Window measures on a numeric index column in metric views
Supports unitless offset and ranges on consecutive integer columns, useful for non-calendar periods like fiscal weeks.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Session restore for serverless jobs is in Public Preview
Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.
- Standard performance mode is now available for one-time runs in the Jobs API
Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.
- Maintenance windows for continuous pipelines
Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.
- Managed tables in Lakeflow pipelines (Beta)
Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.
- Anaplan connector (Beta)
Ingests Anaplan audit trail events and user account records into Databricks.
- Anysphere Organization connector (Beta)
Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.
- Celigo connector (Beta)
Ingests Celigo audit log events into Databricks using an API token.
- Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon
Replaces full snapshot default, improving performance and reducing cost.
- Lakebase now supports PCI-DSS and HITRUST in all AWS regions
Requires compliance security profile enabled. Previously limited to us-east-1 region.
- See which chunks support each ai_search answer (Beta)
Added generate_citations option to show supporting chunks.
- time_bucket SQL function aligns timestamps to fixed-width time buckets
Replaces date_trunc for non-calendar units, requires origin and width parameters.
- Zerobus Ingest into default storage is now in Public Preview
Supports tables backed by default storage, requires Lakeflow Connect setup.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Lakebase now available in Azure Japan East region (japaneast)
Available in japaneast region, requires Postgres database setup.
- Git Folder Serverless is in Beta
Shares serverless compute and pyproject.toml environment across notebooks and files.
- Apache Arrow support for Zerobus Ingest is now generally available
Replaces JSON and Avro formats, requires Lakeflow Connect.
- Pipeline events system table is in Beta
Records Lakeflow pipeline event logs, capturing lifecycle transitions and errors, for querying and building alerts.
- Atlassian Audit Logs connector (Beta)
Ingests Atlassian organization audit log events using an API key.
- Genie Code for AI Runtime (Public Preview)
Generates distributed training code and resolves environment issues. Requires AI Runtime.
- Genie Code is now available as a Lakeflow Jobs task (Beta)
Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.
- Zerobus Ingest into streaming tables is now generally available
Works like writing to a managed Delta table with same limits and quotas.
- Anysphere Audit Logs connector (Beta)
Uses Anysphere Admin API to ingest audit-log events, requires Cursor Admin API key.
- LTAP Direct Writes accelerates synced table loads (Beta)
Requires Postgres 17, enabled from Previews page. Writes directly to storage layer.
- Genie Code is now available in the Lakebase project UI
Lets you run multi-step data and AI tasks with natural language input. Available for all Lakebase projects.
- Postgres minor version updates
Updates to 16.15, 17.11, and 18.6, applied on compute restart.
- Verkada connector (Beta)
Ingests Verkada organization audit logs and access users using a Verkada API key.
- Default Python package repositories are GA for Lakeflow pipelines and classic compute
Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.
- Lakebase adds compliance security profile standards on Azure
Supports ISMAP, IRAP, and UK Cyber Essentials Plus on Azure.
- Performance mode now applies to materialized view and streaming table refreshes from dbt tasks
Now applies to dbt tasks, with optional Standard mode for lower costs, increasing latency to 4-6 minutes.
- Salesforce connector mTLS authentication is now generally available
Replaces OAuth client credentials flow for API-only users, requires client certificates.
- Lakebase available in four new Azure regions
Added to North Central US, France Central, Germany West Central, and East Asia regions.
- Manage project environments with %uv commands
Requires environment version 5 or above. Supports serverless notebooks.
- Lakebase Postgres APIs are now generally available
Supports operations for projects, branches, and databases through REST API, CLI, and SDKs.
- Workiva connector (Beta)
Ingests Workiva audit activity, users, and roles using OAuth2 client credentials.
- Gmail connector in Lakeflow Connect (Beta)
Ingests messages, labels, drafts, filters, and profile data using a Google service account.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.