Databricks releases, every cloud
- Tags for dashboards, notebooks, Databricks apps, and Genie Agents are now generally available
Tags support both governed and ungoverned key-value pairs. They can be applied to organize workspace assets.
- Scala UDFs can access Unity Catalog secrets
They use the caller's or function owner's permissions. Requires environment version 6 or Databricks Runtime 19.
- Scalar and Batch Unity Catalog Python UDFs are now generally available
They work on all supported compute types and remove the five-UDF-call-per-query limit. Environment version 6 or above is required for some capabilities.
- Time travel queries now enforce ABAC policies (Beta)
Requires Databricks Runtime 19 and Unity Catalog managed tables.
- Lakebase backup schedule API (Beta)
Manages automated snapshot cadences and retention. Available to all Lakebase workspaces.
- Shopify connector (Beta)
It ingests e-commerce data from Shopify into Databricks. Authentication uses Shopify OAuth client credentials grant.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Variant shredding will soon be enabled by default on new Variant tables Coming soon
Requires Databricks Runtime 17.3 or above. Breaks compatibility with Databricks Runtime 15.4.
- Lakebase Search is generally available
Adds scalable vector and keyword search to Lakebase projects via Postgres extensions.
- Metastore-level ABAC policies are in Beta
Applies across every catalog in the metastore. Replaces per-catalog policy setup.
- VARIANT cast extends to ARRAY and MAP columns in ABAC column masks
Requires Databricks Runtime 19 or above. Supports ARRAY and MAP in addition to STRUCT.
- Data Classification now scans Unity Catalog views (Beta)
Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.
- Lakebase snapshots API (Beta)
Manages point-in-time snapshots of project branches, allowing create, get, list, delete, and restore operations.
- The READ METADATA privilege will soon be available by default for workspaces with the compliance security profile enabled Coming soon
Grants read-only visibility into object metadata, including security-sensitive information.
- JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon
Replaces cluster provisioning, available in Lakeflow Jobs.
- The counter_diff SQL window function is now available
Calculates differences between consecutive cumulative counter values, available in Databricks Runtime 19 and above.
- Window measures on a numeric index column in metric views
Supports unitless offset and ranges on consecutive integer columns, useful for non-calendar periods like fiscal weeks.
- Session restore for serverless jobs is in Public Preview
Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.
- Standard performance mode is now available for one-time runs in the Jobs API
Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Maintenance windows for continuous pipelines
Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.
- Managed tables in Lakeflow pipelines (Beta)
Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.
- Anaplan connector (Beta)
Ingests Anaplan audit trail events and user account records into Databricks.
- Anysphere Organization connector (Beta)
Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.
- Celigo connector (Beta)
Ingests Celigo audit log events into Databricks using an API token.
- External secrets in Unity Catalog (Beta)
Connects Unity Catalog schema to AWS Secrets Manager, appearing as read-only objects.
- ABAC DENY policies are in Beta
Explicitly deny MANAGE ACCESS CONTROL privilege, taking precedence over grants.
- Databricks SQL version 2026.36 is rolling out in Current
It includes features from version 2026.32.
- Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon
Replaces full snapshot default, improving performance and reducing cost.
- Lakebase now supports PCI-DSS and HITRUST in all AWS regions
Requires compliance security profile enabled. Previously limited to us-east-1 region.
- See which chunks support each ai_search answer (Beta)
Added generate_citations option to show supporting chunks.
- time_bucket SQL function aligns timestamps to fixed-width time buckets
Replaces date_trunc for non-calendar units, requires origin and width parameters.
- Zerobus Ingest into default storage is now in Public Preview
Supports tables backed by default storage, requires Lakeflow Connect setup.
- Lakebase now available in Azure Japan East region (japaneast)
Available in japaneast region, requires Postgres database setup.
- Apache Arrow support for Zerobus Ingest is now generally available
Replaces JSON and Avro formats, requires Lakeflow Connect.
- ABAC GRANT policies are generally available for models and services
They grant Unity Catalog privileges based on governed tags, replacing individual object grants.
- Databricks SQL version 2026.36 is now available in Preview
It includes features from version 2026.32.
- Pipeline events system table is in Beta
Records Lakeflow pipeline event logs, capturing lifecycle transitions and errors, for querying and building alerts.
- Unity Catalog Skills (Beta)
Publishes and governs agent skills, controlling access with Unity Catalog permissions.
- Atlassian Audit Logs connector (Beta)
Ingests Atlassian organization audit log events using an API key.
- Genie Code is now available as a Lakeflow Jobs task (Beta)
Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.
- Zerobus Ingest into streaming tables is now generally available
Works like writing to a managed Delta table with same limits and quotas.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.