Databricks releases, every cloud
- Serverless egress control is now generally available
Manages outbound connections with restricted access and FQDN filtering.
- Applying filters, masks, tags, and comments to pipeline-created datasets is now GA
Modifies ETL and ingestion pipelines using CREATE, ALTER, or Lakeflow UI. Applies to Spark Declarative Pipelines on Lakeflow and Lakeflow Connect.
- Google Ads connector (Beta)
Ingests data from Google Ads into Databricks via Lakeflow Connect.
- Automatically provision users (JIT) GA
Creates accounts during SSO login if none exist. Requires single sign-on setup.
- Zendesk Support connector (Beta)
Ingests ticket, help center, and community forum data from Zendesk Support.
- Trigger on update for pipelines (GA)
Refreshes pipeline when source table changes, usable in Databricks SQL pipeline schedules.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- View and restore your recent workspace tab sessions
Restores up to 10 recent sessions.
- Improved group sharing for automatic identity management
Shares account-level assets with Microsoft Entra ID groups. Requires automatic identity management.
- Google Drive connector (Beta)
Supports read_files, spark.read, COPY INTO, and Auto Loader for ingesting files.
- Front-end PrivateLink for performance-intensive services (Beta)
Supports private connectivity to Zerobus Ingest and Lakebase Autoscaling.
- Ingest Salesforce formula fields incrementally (Beta)
Replaces snapshotting with incremental ingestion, improving performance and reducing costs.
- Row filtering for managed ingestion connectors (Beta)
Applies conditions like a SQL WHERE clause, available for Google Analytics, Salesforce, and ServiceNow connectors.
- Simplified serverless network security with Azure Network Security Perimeter
Uses AzureDatabricksServerless service tag, replacing subnet-based rules.
- Automatic email notifications for expiring personal access tokens (GA)
Sends emails 14 days before token expiration, requires token lifetime to be set.
- Meta Ads connector (Beta)
Ingests data from Meta Ads, requires setup as a data source.
- MySQL connector in Lakeflow Connect (Public Preview)
Enables incremental data ingestion from various MySQL databases. Requires access request through account team.
- Updated Lakeflow Jobs UI is generally available
Simplifies job creation and editing, see Lakeflow Jobs for details.
- Context based ingress control is now in Public Preview
Enables account admins to set allow and deny rules based on identity, request type, and network source.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Confluence connector (Beta)
Ingests Confluence spaces and pages into Databricks, requires OAuth U2M configuration.
- PostgreSQL connector in Lakeflow Connect (Public Preview)
Enables incremental data ingestion from various PostgreSQL databases. Requires configuration.
- Change owner for materialized views or streaming tables defined in Databricks SQL
Done through Catalog Explorer, replacing previous methods.
- Customizable SharePoint connector (Beta)
Ingests structured, semi-structured, and unstructured files into Delta tables with customizable schema inference and parsing options.
- Discover files in Auto Loader efficiently using file events
Requires file events enabled on external locations. Replaces directory listing for efficiency.
- Jira connector (Beta)
Ingests Jira issues, comments, and attachments metadata into Databricks.
- Microsoft Dynamics 365 connector (Public Preview)
Ingests data from Dynamics 365 apps into Databricks. Requires Lakeflow Connect.
- NetSuite connector (Public Preview)
Ingests data from NetSuite2.com via API, CLI, or notebook.
- ForEachBatch for Spark Declarative Pipelines on Lakeflow is available (Public Preview)
Allows processing streams as micro-batches in Python. Requires Lakeflow setup.
- Expanded regional availability for C5 and TISAX compliance
Now available in all regions and with serverless compute.
- Spark Declarative Pipelines on Lakeflow stream progress metrics are generally available
Supports querying event log for stream progress metrics.
- Configure full refresh behavior for managed database connectors
Applies to Lakeflow Connect managed database connectors, allowing scheduled full refresh snapshots and automatic recovery from unsupported schema changes.
- Automatic email notifications for expiring personal access tokens (Public Preview)
Sends emails 7 days before token expiration.
- Databricks SQL version 2025.35 is rolling out in Current
Includes new features, see documentation for details.
- Delta Sharing views automatically permitted in serverless network policies
Permitted regardless of storage location alignment between shared tables and view dependencies. Simplifies network policy configuration.
- Jobs can now be triggered on source view update
Supports views referencing supported table types, see documentation for specifics.
- Databricks SQL alerts are now in Public Preview
Offers a new editing experience, replacing the previous version.
- Improved full refresh flow for managed database connectors
Reduces downtime by delaying table refresh until snapshot completion, minimizing PENDING_RESET errors.
- Convert foreign tables to Unity Catalog managed or external tables (Public Preview)
Requires Databricks Runtime 17.0 LTS or above. Uses ALTER TABLE SET MANAGED or SET EXTERNAL.
- SFTP connector (Public Preview)
Extends Auto Loader to ingest files from SFTP servers.
- TISAX compliance controls (Public Preview)
Enhances workspace compliance based on ISO/IEC 27001 and VDA ISA requirements.
- Lakeflow Declarative Pipelines has been renamed to Lakeflow Spark Declarative Pipelines
Replaces Lakeflow Declarative Pipelines, see Spark Declarative Pipelines for details.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.