Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

186 releases of 1340

Last updated

  1. File events enabled by default on new external locations

    Enabled on new locations, detects file changes for storage jobs and pipelines, can be disabled after creation.

    #Auto Loader#Lakeflow#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. HubSpot connector (Beta)

    Ingests HubSpot Marketing Hub data into Databricks via Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  3. Configure default Python package repositories for Spark Declarative Pipelines on Lakeflow (Public Preview)

    Allows installation from internal Python repositories without index-url or extra-index-url. Requires workspace admin configuration.

    #Admin Guide#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. Serverless compute now available for compliance standards

    Adds HITRUST, PCI-DSS, TISAX, and UK Cyber Essentials Plus support.

    #Serverless
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  5. Applying filters, masks, tags, and comments to pipeline-created datasets is now GA

    Modifies ETL and ingestion pipelines using CREATE, ALTER, or Lakeflow UI. Applies to Spark Declarative Pipelines on Lakeflow and Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. Google Ads connector (Beta)

    Ingests data from Google Ads into Databricks via Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. New GCP regions support serverless compute

    Available in me-central1 and southamerica-east1 regions.

    #Serverless
    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  9. Zendesk Support connector (Beta)

    Ingests ticket, help center, and community forum data from Zendesk Support.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. Trigger on update for pipelines (GA)

    Refreshes pipeline when source table changes, usable in Databricks SQL pipeline schedules.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  11. View and restore your recent workspace tab sessions

    Restores up to 10 recent sessions.

    #Lakeflow#Notebooks#Workspace
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  12. Serverless workspaces are now generally available

    Come pre-configured with serverless compute and default storage.

    #Serverless#Workspace
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  13. Google Drive connector (Beta)

    Supports read_files, spark.read, COPY INTO, and Auto Loader for ingesting files.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  14. You can now use custom base environments for Python, Python Wheels, and notebook tasks in serverless jobs

    Defined with YAML files, they support Python, Python wheel, and notebook tasks.

    #Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  15. Ingest Salesforce formula fields incrementally (Beta)

    Replaces snapshotting with incremental ingestion, improving performance and reducing costs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  16. Row filtering for managed ingestion connectors (Beta)

    Applies conditions like a SQL WHERE clause, available for Google Analytics, Salesforce, and ServiceNow connectors.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  17. Meta Ads connector (Beta)

    Ingests data from Meta Ads, requires setup as a data source.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  18. MySQL connector in Lakeflow Connect (Public Preview)

    Enables incremental data ingestion from various MySQL databases. Requires access request through account team.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  19. Updated Lakeflow Jobs UI is generally available

    Simplifies job creation and editing, see Lakeflow Jobs for details.

    #Lakeflow
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Serverless compute is now available in Azure China North 3

    Available for notebooks, jobs, pipelines, and SQL warehouses.

    #Serverless
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  22. Confluence connector (Beta)

    Ingests Confluence spaces and pages into Databricks, requires OAuth U2M configuration.

    #Data Ingestion#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  23. PostgreSQL connector in Lakeflow Connect (Public Preview)

    Enables incremental data ingestion from various PostgreSQL databases. Requires configuration.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  24. Serverless workspaces are now available in new GCP regions

    Available in most GCP regions, see documentation for list.

    #Serverless
    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  25. Change owner for materialized views or streaming tables defined in Databricks SQL

    Done through Catalog Explorer, replacing previous methods.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  26. Customizable SharePoint connector (Beta)

    Ingests structured, semi-structured, and unstructured files into Delta tables with customizable schema inference and parsing options.

    #Data ingestion#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  27. Discover files in Auto Loader efficiently using file events

    Requires file events enabled on external locations. Replaces directory listing for efficiency.

    #Auto Loader#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  28. Jira connector (Beta)

    Ingests Jira issues, comments, and attachments metadata into Databricks.

    #Data Ingestion#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  29. Microsoft Dynamics 365 connector (Public Preview)

    Ingests data from Dynamics 365 apps into Databricks. Requires Lakeflow Connect.

    #Data ingestion#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  30. NetSuite connector (Public Preview)

    Ingests data from NetSuite2.com via API, CLI, or notebook.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  31. ForEachBatch for Spark Declarative Pipelines on Lakeflow is available (Public Preview)

    Allows processing streams as micro-batches in Python. Requires Lakeflow setup.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  32. Spark Declarative Pipelines on Lakeflow stream progress metrics are generally available

    Supports querying event log for stream progress metrics.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  33. Configure full refresh behavior for managed database connectors

    Applies to Lakeflow Connect managed database connectors, allowing scheduled full refresh snapshots and automatic recovery from unsupported schema changes.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  34. Serverless compute is now available in new regions

    Added to Australia Southeast, Canada Central, Mexico Central, Norway East, and South Africa North regions.

    #Serverless
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  35. Jobs can now be triggered on source view update

    Supports views referencing supported table types, see documentation for specifics.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  36. Improved full refresh flow for managed database connectors

    Reduces downtime by delaying table refresh until snapshot completion, minimizing PENDING_RESET errors.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  37. SFTP connector (Public Preview)

    Extends Auto Loader to ingest files from SFTP servers.

    #Auto Loader#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  38. Lakeflow Declarative Pipelines has been renamed to Lakeflow Spark Declarative Pipelines

    Replaces Lakeflow Declarative Pipelines, see Spark Declarative Pipelines for details.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  39. List MCP servers in Azure Databricks Marketplace (Public Preview)

    Allows distribution of AI tools and connection to external data sources, requires provider listing.

    #Marketplace
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  40. List MCP servers in Databricks Marketplace (Public Preview)

    Lets users install MCP servers to connect AI agents to external data sources.

    #Marketplace
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  41. Serverless notebook tasks can now use jobs environment

    Replaces inherited serverless environment with configurable job environment.

    #Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  42. JAR tasks are now supported on serverless compute

    Run JAR jobs without a cluster.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.

We measure how the site is used. PostHog and Google Analytics, set to measurement only with advertising features off. We do not sell your data or share it for advertising, and you can turn this off. What this stores.