Skip to content

Databricks releases, every cloud

187 releases of 1321

Last updated

  1. Managed RabbitMQ connector (Beta)

    Streams messages from RabbitMQ classic queues into Unity Catalog streaming tables.

  2. Pendo connector (Beta)

    Ingests data from Pendo into Lakeflow. Requires Lakeflow Connect.

  3. Query-based connectors for Lakeflow Connect are now generally available

    Ingests data from databases like Oracle and PostgreSQL without CDC configuration.

  4. Google Drive managed ingestion connector (Beta)

    Ingests files from Google Drive into Databricks, supporting unstructured and structured data.

  5. Real-time mode in Spark Declarative Pipelines on Lakeflow, and the update_flow API are now available (Public Preview)

    Achieves end-to-end latency as low as 5ms, uses update output mode.

  6. Refresh policies and EXPLAIN CREATE MATERIALIZED VIEW for materialized views are now generally available

    Requires Databricks Runtime 17.3 and above. Available in Databricks SQL.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Workspace admin setting for serverless notebook execution timeout

    Replaces manual override process, defaults to 2.5 hours.

  9. Spark Declarative Pipelines on Lakeflow parameters are now in Beta

    Define key-value pairs at pipeline level, referenced in SQL using named parameter syntax.

  10. Serve custom LLMs with Custom Model Serving (Beta)

    Supports multimodal models and PEFT recipes, unlike Foundation Model APIs.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  11. Unified runs list is generally available

    Replaces separate job and pipeline run lists, adds filtering and error code visualization.

  12. Spark Declarative Pipelines on Lakeflow sinks are now generally available

    Supports writing to Delta tables, Kafka topics, and Azure Event Hubs.

  13. Spark Declarative Pipelines on Lakeflow environment versions (Beta)

    Pins Python version and libraries, decoupling from Databricks Runtime upgrades.

  14. SQL alert task in Lakeflow Jobs is now in Public Preview

    Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state as output.

  15. Version 18.2

    Adds CREATE OR REPLACE TEMP TABLE syntax and upgrades Snowflake JDBC driver to 3.28.0.

  16. HubSpot connector (GA)

    Ingests data from HubSpot Marketing Hub into Databricks.

  17. Faster package installs with %uv pip in serverless notebooks

    Requires environment version 5 or above. Replaces %pip for faster installs.

  18. Standalone pipelines on serverless general compute (Beta)

    Requires serverless general compute, created via SQL or Python.

  19. GitHub managed ingestion connector (Beta)

    ingests GitHub data into Databricks, available in Lakeflow Connect.

  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Outlook managed ingestion connector (Beta)

    Ingests email data from Microsoft Outlook into Databricks.

  22. Smartsheet managed ingestion connector (Beta)

    Ingests Smartsheet data into Databricks, available in Lakeflow Connect.

  23. Lakeflow Pipelines Editor is now generally available

    Offers agent-first experience with Genie Code for creating production pipelines.

  24. Community connectors (Beta)

    Extends Lakeflow Connect to unsupported sources, built by the community.

  25. Disabling tasks in Lakeflow Jobs is now GA

    Disabled tasks retain config and run history, can be re-enabled later.

  26. Zendesk Support connector (GA)

    Allows syncing Zendesk tickets to Databricks.

  27. Confluence connector (GA)

    Allows reading Confluence spaces and pages into Databricks.

  28. Workspace base environments are now generally available

    Lets workspace admins create pre-built environments for serverless notebooks, enabled by default in compliance security profile workspaces.

  29. Lakeflow Designer is now in Public Preview

    Offers drag-and-drop canvas and natural language for building data workflows.

  30. AI Runtime 1xH100 accelerator (Beta)

    Supports 1xH100 accelerator, see Hardware options for details.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  31. Version 18.1

    Supports DATETIMEOFFSET for Azure Synapse and adds schema evolution with INSERT statements.

  32. Query-based connectors for Lakeflow Connect (Public Preview)

    Ingests data from databases using a cursor column, supporting Oracle, Teradata, and others.

  33. New cascade field for deleting Unity Catalog pipelines (Beta)

    Deletes associated materialized views and tables by default, set cascade=false to retain them.

  34. Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon

    Deletes now retain associated tables by default, set cascade=true to remove them.

  35. AI Runtime is now in Public Preview

    Adds GPU support to serverless compute for deep learning workloads.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  36. Databricks SQL pipelines support notifications and performance mode (Beta)

    Supports failure notifications and serverless performance mode for materialized views and streaming tables.

  37. Declarative Feature Engineering APIs (Beta)

    Define time-windowed aggregation features from data sources, materialize to Delta tables or Lakebase. Available in us-east-1 and us-west-2 regions.

    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(not on this cloud)
  38. Workday HCM connector (Beta)

    Ingests Workday Human Capital Management data into Databricks.

  39. Endpoint telemetry for custom model serving endpoints (Beta)

    Stores logs, traces, and metrics in Unity Catalog Delta tables using OpenTelemetry.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  40. Serverless compute now available for IRAP and Canada Protected B workloads on Azure Databricks

    Requires environment version 5 to be enabled.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  41. Version 18.0

    Upgrades Redshift JDBC driver to 2.1.0.28, adds SQL window functions to metric views.

  42. Serverless environment version 5 is now available

    Includes CPU and GPU versions.

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.