Databricks releases, every cloud
- Configure default Python package repositories for Spark Declarative Pipelines on Lakeflow (Public Preview)
Allows installation from internal Python repositories without index-url or extra-index-url. Requires workspace admin configuration.
- Databricks SQL version 2025.40 is now available in Preview
Adds SQL scripting with procedural logic and expands parameter markers and IDENTIFIER clause support.
- Applying filters, masks, tags, and comments to pipeline-created datasets is now GA
Modifies ETL and ingestion pipelines using CREATE, ALTER, or Lakeflow UI. Applies to Spark Declarative Pipelines on Lakeflow and Lakeflow Connect.
- Google Ads connector (Beta)
Ingests data from Google Ads into Databricks via Lakeflow Connect.
- Select tables and create pivot tables in Google Sheets
Imports data via Databricks Connector, selecting from Catalog Explorer.
- Zendesk Support connector (Beta)
Ingests ticket, help center, and community forum data from Zendesk Support.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Trigger on update for pipelines (GA)
Refreshes pipeline when source table changes, usable in Databricks SQL pipeline schedules.
- View and restore your recent workspace tab sessions
Restores up to 10 recent sessions.
- Google Drive connector (Beta)
Supports read_files, spark.read, COPY INTO, and Auto Loader for ingesting files.
- Ingest Salesforce formula fields incrementally (Beta)
Replaces snapshotting with incremental ingestion, improving performance and reducing costs.
- Row filtering for managed ingestion connectors (Beta)
Applies conditions like a SQL WHERE clause, available for Google Analytics, Salesforce, and ServiceNow connectors.
- Meta Ads connector (Beta)
Ingests data from Meta Ads, requires setup as a data source.
- MySQL connector in Lakeflow Connect (Public Preview)
Enables incremental data ingestion from various MySQL databases. Requires access request through account team.
- Updated Lakeflow Jobs UI is generally available
Simplifies job creation and editing, see Lakeflow Jobs for details.
- Login required to download ODBC driver
Requires login and license acceptance, except for AWS GovCloud which needs account team access.
- Confluence connector (Beta)
Ingests Confluence spaces and pages into Databricks, requires OAuth U2M configuration.
- PostgreSQL connector in Lakeflow Connect (Public Preview)
Enables incremental data ingestion from various PostgreSQL databases. Requires configuration.
- Change owner for materialized views or streaming tables defined in Databricks SQL
Done through Catalog Explorer, replacing previous methods.
- Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Customizable SharePoint connector (Beta)
Ingests structured, semi-structured, and unstructured files into Delta tables with customizable schema inference and parsing options.
- Discover files in Auto Loader efficiently using file events
Requires file events enabled on external locations. Replaces directory listing for efficiency.
- Jira connector (Beta)
Ingests Jira issues, comments, and attachments metadata into Databricks.
- Microsoft Dynamics 365 connector (Public Preview)
Ingests data from Dynamics 365 apps into Databricks. Requires Lakeflow Connect.
- NetSuite connector (Public Preview)
Ingests data from NetSuite2.com via API, CLI, or notebook.
- ForEachBatch for Spark Declarative Pipelines on Lakeflow is available (Public Preview)
Allows processing streams as micro-batches in Python. Requires Lakeflow setup.
- Spark Declarative Pipelines on Lakeflow stream progress metrics are generally available
Supports querying event log for stream progress metrics.
- Configure full refresh behavior for managed database connectors
Applies to Lakeflow Connect managed database connectors, allowing scheduled full refresh snapshots and automatic recovery from unsupported schema changes.
- Databricks SQL version 2025.35 is rolling out in Current
Includes new features, see documentation for details.
- Jobs can now be triggered on source view update
Supports views referencing supported table types, see documentation for specifics.
- Databricks SQL alerts are now in Public Preview
Offers a new editing experience, replacing the previous version.
- Improved full refresh flow for managed database connectors
Reduces downtime by delaying table refresh until snapshot completion, minimizing PENDING_RESET errors.
- Convert foreign tables to Unity Catalog managed or external tables (Public Preview)
Requires Databricks Runtime 17.0 LTS or above. Uses ALTER TABLE SET MANAGED or SET EXTERNAL.
- SFTP connector (Public Preview)
Extends Auto Loader to ingest files from SFTP servers.
- Lakeflow Declarative Pipelines has been renamed to Lakeflow Spark Declarative Pipelines
Replaces Lakeflow Declarative Pipelines, see Spark Declarative Pipelines for details.
- SQL Editor visualization fix
Tooltips now display in front of the legend.
- JAR tasks are now supported on serverless compute
Run JAR jobs without a cluster.
- Salesforce ingestion connector supports history tracking (SCD type 2)
Enables history tracking, overwriting default SCD type 1 behavior.
- Databricks SQL version 2025.35 is now available in Preview
Adds EXECUTE IMMEDIATE constant expressions and LIMIT ALL for recursive CTEs.
- Zerobus Ingest connector in Lakeflow Connect (Public Preview)
Enables record-by-record ingestion into Delta tables via gRPC API.
- New alert editing experience
Replaces old editor with a multi-tab editor for unified workflow.
- Unified runs list (Public Preview)
Combines job and pipeline runs into one list.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.