Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

169 releases of 1354

Last updated

  1. Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is now GA

    Replaces legacy single-catalog publishing with multi-catalog support.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Microsoft SQL Server connector GA

    Replaces manual ingestion scripts, requires Lakeflow Connect setup.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  3. Set the run-as user for Spark Declarative Pipelines on Lakeflow

    Replaces user accounts with a service principal for automated workloads.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. Spark Declarative Pipelines on Lakeflow template in bundles in the workspace (Public Preview)

    Creates ETL pipelines in workspace bundles using Lakeflow template. Requires New ETL pipeline setup.

    #Bundles#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  5. Jobs in continuous mode can now have task-level retries for failed tasks

    Task-level retries replace job-level retries, require continuous mode.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. ServiceNow connector GA

    Replaces manual API configuration, requires Lakeflow Connect setup.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Jobs & Pipelines list now includes Databricks SQL pipelines

    Includes materialized views and streaming tables created with Databricks SQL.

    #Databricks SQL#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Moving tables between Spark Declarative Pipelines on Lakeflow pipelines is now GA

    Supports moving tables in Unity Catalog ETL pipelines.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. Parent tasks (Run job and For each) now have a separate limit

    Separate limit doesn't count against overall limit, see Resource limits.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.

We measure how the site is used. PostHog and Google Analytics, set to measurement only with advertising features off. We do not sell your data or share it for advertising, and you can turn this off. What this stores.