Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

35 releases of 1321

Last updated

  1. Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon

    Replaces full snapshot default, improving performance and reducing cost.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. Apache Arrow support for Zerobus Ingest is now generally available

    Replaces JSON and Avro formats, requires Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  3. Zerobus Ingest into streaming tables is now generally available

    Works like writing to a managed Delta table with same limits and quotas.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. Consumer access to query Unity Gateway services will become generally available Coming soon

    Requires account admins to set budgets and rate limits beforehand to control model traffic.

    #Databricks AI#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  5. Salesforce connector mTLS authentication is now generally available

    Replaces OAuth client credentials flow for API-only users, requires client certificates.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. Role-based access control (RBAC) is generally available

    Requires account and workspace admin setup. Enables exclusive access to sensitive data.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. JAR tasks on serverless compute are now generally available

    Requires matching Scala, Java Development Kit, and Databricks Connect versions.

    #Lakeflow#Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Serverless compute access control is now generally available

    Governs access to notebooks, jobs, and pipelines through Default Interactive and Automated Compute objects. Existing workloads run unchanged.

    #Compute#Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. Email notifications for expiring service principal tokens are now generally available

    Sends emails to workspace admins 7 days before token expiration for used tokens with lifetime over 7 days. No configuration is required.

    #Administration#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  11. Context-based ingress control for workspaces public access is now generally available

    Uses allow and deny rules to control access based on identities, network sources, and request types.

    #Networking#Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  12. REPLACE WHERE flows are now generally available

    Replaces full table reprocessing with row-level updates based on a predicate.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  13. Lakeflow Connect row filtering is now generally available

    Works like a SQL WHERE clause, applies to initial and incremental updates.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  14. SQL alert task in Lakeflow Jobs is now generally available

    Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state for downstream tasks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  15. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

    #Data Engineering#Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  16. The update_flow API for Spark Declarative Pipelines on Lakeflow is generally available

    Writes to a sink in update output mode, emitting only changed rows. Supports stateful aggregations without a watermark.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  17. Inbound Private Link for performance-intensive services is now generally available

    Supports Lakebase Autoscaling and Zerobus Ingest.

    #Networking#Security
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  18. Query-based connectors for Lakeflow Connect are now generally available

    Ingests data from databases like Oracle and PostgreSQL without CDC configuration.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  19. Refresh policies and EXPLAIN CREATE MATERIALIZED VIEW for materialized views are now generally available

    Requires Databricks Runtime 17.3 and above. Available in Databricks SQL.

    #Databricks SQL#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Automatic identity management with Microsoft Entra ID is now GA

    Replaces SCIM provisioning, syncs users and groups from Microsoft Entra ID.

    #Security
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP, read it on their docs
  22. Unified runs list is generally available

    Replaces separate job and pipeline run lists, adds filtering and error code visualization.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  23. Spark Declarative Pipelines on Lakeflow sinks are now generally available

    Supports writing to Delta tables, Kafka topics, and Azure Event Hubs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  24. Databricks SQL alerts are now generally available

    Monitors data and KPIs by running scheduled queries, notifying recipients when conditions are met.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  25. Lakeflow Pipelines Editor is now generally available

    Offers agent-first experience with Genie Code for creating production pipelines.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  26. Disabling tasks in Lakeflow Jobs is now GA

    Disabled tasks retain config and run history, can be re-enabled later.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  27. Workspace base environments are now generally available

    Lets workspace admins create pre-built environments for serverless notebooks, enabled by default in compliance security profile workspaces.

    #Admin#Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  28. Scoped personal access tokens are now generally available

    Restrict tokens to specific API operations with specified permissions. Coming soon to compliance security profile workspaces.

    #Security
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  29. Customer-managed keys for Unity Catalog are generally available

    Encrypts data in Unity Catalog catalogs using cloud KMS keys. Requires default storage.

    #Security#Unity Catalog
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  30. COMMENT ON streaming tables is now GA

    Adds comments to streaming tables, previously only available for non-streaming tables.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  31. Applying filters, masks, tags, and comments to pipeline-created datasets is now GA

    Modifies ETL and ingestion pipelines using CREATE, ALTER, or Lakeflow UI. Applies to Spark Declarative Pipelines on Lakeflow and Lakeflow Connect.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  32. Serverless workspaces are now generally available

    Come pre-configured with serverless compute and default storage.

    #Serverless#Workspace
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  33. Spark Declarative Pipelines on Lakeflow stream progress metrics are generally available

    Supports querying event log for stream progress metrics.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  34. Migrate Spark Declarative Pipelines on Lakeflow pipelines from legacy publishing mode is generally available

    Replaces legacy mode that only published to a single catalog and schema. Now supports multiple catalogs and schemas.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  35. Migrate Spark Declarative Pipelines on Lakeflow from legacy publishing mode is now GA

    Replaces legacy single-catalog publishing with multi-catalog support.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  36. New SQL editor is generally available

    Provides a unified authoring environment with features like real-time collaboration and enhanced Databricks Assistant integration.

    #Databricks SQL
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  37. Moving tables between Spark Declarative Pipelines on Lakeflow pipelines is now GA

    Supports moving tables in Unity Catalog ETL pipelines.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.