Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

156 releases of 1321

Last updated

  1. Spark Declarative Pipelines on Lakeflow sinks are now generally available

    Supports writing to Delta tables, Kafka topics, and Azure Event Hubs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  2. Spark Declarative Pipelines on Lakeflow environment versions (Beta)

    Pins Python version and libraries, decoupling from Databricks Runtime upgrades.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  3. SQL alert task in Lakeflow Jobs is now in Public Preview

    Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state as output.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  4. HubSpot connector (GA)

    Ingests data from HubSpot Marketing Hub into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  5. Standalone pipelines on serverless general compute (Beta)

    Requires serverless general compute, created via SQL or Python.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  6. GitHub managed ingestion connector (Beta)

    ingests GitHub data into Databricks, available in Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Outlook managed ingestion connector (Beta)

    Ingests email data from Microsoft Outlook into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  9. Smartsheet managed ingestion connector (Beta)

    Ingests Smartsheet data into Databricks, available in Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  10. Lakeflow Pipelines Editor is now generally available

    Offers agent-first experience with Genie Code for creating production pipelines.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  11. Community connectors (Beta)

    Extends Lakeflow Connect to unsupported sources, built by the community.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  12. Disabling tasks in Lakeflow Jobs is now GA

    Disabled tasks retain config and run history, can be re-enabled later.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  13. Zendesk Support connector (GA)

    Allows syncing Zendesk tickets to Databricks.

    #Data Ingestion#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  14. Confluence connector (GA)

    Allows reading Confluence spaces and pages into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  15. Lakeflow Designer is now in Public Preview

    Offers drag-and-drop canvas and natural language for building data workflows.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  16. Query-based connectors for Lakeflow Connect (Public Preview)

    Ingests data from databases using a cursor column, supporting Oracle, Teradata, and others.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  17. New cascade field for deleting Unity Catalog pipelines (Beta)

    Deletes associated materialized views and tables by default, set cascade=false to retain them.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  18. Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon

    Deletes now retain associated tables by default, set cascade=true to remove them.

    #API#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  19. Databricks SQL pipelines support notifications and performance mode (Beta)

    Supports failure notifications and serverless performance mode for materialized views and streaming tables.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Workday HCM connector (Beta)

    Ingests Workday Human Capital Management data into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  22. Change to use_case field in VPC endpoint API responses Coming soon

    Changes from WORKSPACE_ACCESS to GENERAL_ACCESS, see API docs for details.

    #API
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  23. COMMENT ON streaming tables is now GA

    Adds comments to streaming tables, previously only available for non-streaming tables.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  24. JAR tasks on serverless compute is now in Public Preview

    Allows running JAR jobs without a cluster.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  25. TikTok Ads connector (Beta)

    Ingests data from TikTok Ads into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  26. File events enabled by default on new external locations

    Enabled on new locations, detects file changes for storage jobs and pipelines, can be disabled after creation.

    #Auto Loader#Lakeflow#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  27. HubSpot connector (Beta)

    Ingests HubSpot Marketing Hub data into Databricks via Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  28. Configure default Python package repositories for Spark Declarative Pipelines on Lakeflow (Public Preview)

    Allows installation from internal Python repositories without index-url or extra-index-url. Requires workspace admin configuration.

    #Admin Guide#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  29. Applying filters, masks, tags, and comments to pipeline-created datasets is now GA

    Modifies ETL and ingestion pipelines using CREATE, ALTER, or Lakeflow UI. Applies to Spark Declarative Pipelines on Lakeflow and Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  30. Google Ads connector (Beta)

    Ingests data from Google Ads into Databricks via Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  31. Zendesk Support connector (Beta)

    Ingests ticket, help center, and community forum data from Zendesk Support.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  32. Trigger on update for pipelines (GA)

    Refreshes pipeline when source table changes, usable in Databricks SQL pipeline schedules.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  33. View and restore your recent workspace tab sessions

    Restores up to 10 recent sessions.

    #Lakeflow#Notebooks#Workspace
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  34. Google Drive connector (Beta)

    Supports read_files, spark.read, COPY INTO, and Auto Loader for ingesting files.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  35. Ingest Salesforce formula fields incrementally (Beta)

    Replaces snapshotting with incremental ingestion, improving performance and reducing costs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  36. Row filtering for managed ingestion connectors (Beta)

    Applies conditions like a SQL WHERE clause, available for Google Analytics, Salesforce, and ServiceNow connectors.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  37. Meta Ads connector (Beta)

    Ingests data from Meta Ads, requires setup as a data source.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  38. MySQL connector in Lakeflow Connect (Public Preview)

    Enables incremental data ingestion from various MySQL databases. Requires access request through account team.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  39. Updated Lakeflow Jobs UI is generally available

    Simplifies job creation and editing, see Lakeflow Jobs for details.

    #Lakeflow
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  40. Confluence connector (Beta)

    Ingests Confluence spaces and pages into Databricks, requires OAuth U2M configuration.

    #Data Ingestion#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  41. PostgreSQL connector in Lakeflow Connect (Public Preview)

    Enables incremental data ingestion from various PostgreSQL databases. Requires configuration.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  42. Change owner for materialized views or streaming tables defined in Databricks SQL

    Done through Catalog Explorer, replacing previous methods.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.