Skip to content

Databricks releases, every cloud

40 releases of 1321

Last updated

  1. Session restore for serverless jobs is in Public Preview

    Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.

  2. Zerobus Ingest into default storage is now in Public Preview

    Supports tables backed by default storage, requires Lakeflow Connect setup.

  3. Pipeline events system table is in Beta

    Records Lakeflow pipeline event logs, capturing lifecycle transitions and errors, for querying and building alerts.

  4. Alert system tables are in Public Preview

    Contains alerts and alert_evaluation_history tables for auditing and monitoring.

  5. C++ SDK for the Zerobus Ingest connector is now available in Beta

    Supports JSON and Protocol Buffers for ingesting into Unity Catalog Delta tables.

  6. Reddit Ads connector is now available in Beta

    Ingests advertising campaign data and performance metrics from Reddit Ads into Databricks.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. MATCH_RECOGNIZE is now in Beta

    Requires enabling Match Recognize preview in workspace settings.

  9. Metric view parameters are now in Public Preview

    binds values at query time, replacing separate views per variant.

  10. External data access for pipeline streaming tables and materialized views (Public Preview)

    Enables external Delta and Iceberg clients to read data without copying. Uses Unity Catalog and Iceberg catalog REST APIs.

  11. UNIQUE constraint support is now in Public Preview

    Enables join elimination and DISTINCT simplification on Photon-enabled compute. Applies to Unity Catalog Delta Lake tables.

  12. Real-time mode in Spark Declarative Pipelines on Lakeflow, and the update_flow API are now available (Public Preview)

    Achieves end-to-end latency as low as 5ms, uses update output mode.

  13. Spark Declarative Pipelines on Lakeflow parameters are now in Beta

    Define key-value pairs at pipeline level, referenced in SQL using named parameter syntax.

  14. SQL alert task in Lakeflow Jobs is now in Public Preview

    Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state as output.

  15. App telemetry for Databricks Apps is now in Public Preview

    Collects traces, logs, and metrics via OpenTelemetry protocol to Unity Catalog tables.

  16. 5X-Large SQL warehouse size (Public Preview)

    Provides 512 workers, available in all regions, controlled from Previews page.

  17. Lakeflow Designer is now in Public Preview

    Offers drag-and-drop canvas and natural language for building data workflows.

  18. Query-based connectors for Lakeflow Connect (Public Preview)

    Ingests data from databases using a cursor column, supporting Oracle, Teradata, and others.

  19. JAR tasks on serverless compute is now in Public Preview

    Allows running JAR jobs without a cluster.

  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Configure default Python package repositories for Spark Declarative Pipelines on Lakeflow (Public Preview)

    Allows installation from internal Python repositories without index-url or extra-index-url. Requires workspace admin configuration.

  22. Tag Databricks Apps (Public Preview)

    Organize and categorize apps, but search is not supported.

  23. MySQL connector in Lakeflow Connect (Public Preview)

    Enables incremental data ingestion from various MySQL databases. Requires access request through account team.

  24. PostgreSQL connector in Lakeflow Connect (Public Preview)

    Enables incremental data ingestion from various PostgreSQL databases. Requires configuration.

  25. Microsoft Dynamics 365 connector (Public Preview)

    Ingests data from Dynamics 365 apps into Databricks. Requires Lakeflow Connect.

  26. NetSuite connector (Public Preview)

    Ingests data from NetSuite2.com via API, CLI, or notebook.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  27. ForEachBatch for Spark Declarative Pipelines on Lakeflow is available (Public Preview)

    Allows processing streams as micro-batches in Python. Requires Lakeflow setup.

  28. Configure compute size for Databricks Apps (Public Preview)

    Controls CPU, memory, and cost based on workload requirements.

  29. Databricks SQL alerts are now in Public Preview

    Offers a new editing experience, replacing the previous version.

  30. Convert foreign tables to Unity Catalog managed or external tables (Public Preview)

    Requires Databricks Runtime 17.0 LTS or above. Uses ALTER TABLE SET MANAGED or SET EXTERNAL.

  31. SFTP connector (Public Preview)

    Extends Auto Loader to ingest files from SFTP servers.

  32. Zerobus Ingest connector in Lakeflow Connect (Public Preview)

    Enables record-by-record ingestion into Delta tables via gRPC API.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  33. Unified runs list (Public Preview)

    Combines job and pipeline runs into one list.

  34. Lakeflow Pipelines Editor is now in public preview

    Replaces multi-file editor, edits pipelines as files in asset browser, defaults to Python and SQL code.

  35. Discover files in Auto Loader efficiently using file events without enrollment (Public Preview)

    Requires file events enabled on external locations.

  36. Spark Declarative Pipelines on Lakeflow now supports stream progress metrics in Public Preview

    Supports querying event log for stream progress metrics.

  37. Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is rolled back to Public Preview

    Reverts migration feature to Public Preview due to issues. Requires re-enabling default publishing mode in pipelines.

  38. Default warehouse setting is now available in Beta

    Applied across SQL editor, AI/BI dashboards, and other tools, with optional user override.

  39. Spark Declarative Pipelines on Lakeflow template in bundles in the workspace (Public Preview)

    Creates ETL pipelines in workspace bundles using Lakeflow template. Requires New ETL pipeline setup.

  40. Metric views are in Public Preview

    Requires a SQL warehouse on the 2025.16 Preview channel. Abstracts complex business logic into a centralized definition.

  41. New alert version in Beta

    Simplifies creating and managing alerts with a single interface, can be used alongside legacy alerts.

  42. CAN VIEW permission for SQL warehouses is in Public Preview

    Allows monitoring of SQL warehouses, including query history and profiles, without allowing query execution.

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.

We measure how the site is used. PostHog and Google Analytics, set to measurement only with advertising features off. We do not sell your data or share it for advertising, and you can turn this off. What this stores.