Skip to content

Databricks releases, every cloud

53 releases of 1321

Last updated

  1. Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon

    Replaces full snapshot default, improving performance and reducing cost.

  2. Apache Arrow support for Zerobus Ingest is now generally available

    Replaces JSON and Avro formats, requires Lakeflow Connect.

  3. HITRUST and IRAP compliance controls are now generally available

    Available through compliance security profile, required for HIPAA, HITRUST, and IRAP.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  4. AI Functions REST API is now generally available

    Includes ai_parse_document, ai_extract, and ai_classify calls.

  5. Zerobus Ingest into streaming tables is now generally available

    Works like writing to a managed Delta table with same limits and quotas.

  6. Consumer access to query Unity Gateway services will become generally available Coming soon

    Requires account admins to set budgets and rate limits beforehand to control model traffic.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Salesforce connector mTLS authentication is now generally available

    Replaces OAuth client credentials flow for API-only users, requires client certificates.

  9. ai_extract precision mode is now generally available

    Supports multi-page documents and schemas with 50+ fields.

  10. Role-based access control (RBAC) is generally available

    Requires account and workspace admin setup. Enables exclusive access to sensitive data.

  11. JAR tasks on serverless compute are now generally available

    Requires matching Scala, Java Development Kit, and Databricks Connect versions.

  12. Unity Gateway is now generally available

    Controls AI service access and traffic, part of Unity Catalog, with some features still in Beta.

  13. Email notifications for expiring service principal tokens are now generally available

    Sends emails to workspace admins 7 days before token expiration for used tokens with lifetime over 7 days. No configuration is required.

  14. Context-based ingress control for workspaces public access is now generally available

    Uses allow and deny rules to control access based on identities, network sources, and request types.

  15. REPLACE WHERE flows are now generally available

    Replaces full table reprocessing with row-level updates based on a predicate.

  16. Budgets are now generally available

    Define spending thresholds with optional per-user overrides and actions like email alerts.

  17. Lakeflow Connect row filtering is now generally available

    Works like a SQL WHERE clause, applies to initial and incremental updates.

  18. SQL alert task in Lakeflow Jobs is now generally available

    Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state for downstream tasks.

  19. ai_query is now generally available

    Lets you query AI models from SQL or Python.

  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. AUTO CDC flows for streaming tables in Databricks SQL are generally available

    Automatically handles out-of-order records as SCD type 1 or 2, replacing complex MERGE INTO logic.

  22. ai_classify is now generally available

    Classifies text content according to custom labels with support for multi-label classification.

  23. ai_extract is now generally available

    Extracts structured data from text and documents according to a provided schema. Supports nested objects and arrays.

  24. Endpoint telemetry for custom model serving endpoints is generally available

    Persists OpenTelemetry logs, traces, and metrics to Unity Catalog tables.

  25. The update_flow API for Spark Declarative Pipelines on Lakeflow is generally available

    Writes to a sink in update output mode, emitting only changed rows. Supports stateful aggregations without a watermark.

  26. Inbound Private Link for performance-intensive services is now generally available

    Supports Lakebase Autoscaling and Zerobus Ingest.

    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  27. Foundation model Unity Catalog permissions is generally available

    Requires account team enablement, controls access to system.ai schema.

  28. Query-based connectors for Lakeflow Connect are now generally available

    Ingests data from databases like Oracle and PostgreSQL without CDC configuration.

  29. Refresh policies and EXPLAIN CREATE MATERIALIZED VIEW for materialized views are now generally available

    Requires Databricks Runtime 17.3 and above. Available in Databricks SQL.

  30. Automatic identity management with Microsoft Entra ID is now GA

    Replaces SCIM provisioning, syncs users and groups from Microsoft Entra ID.

  31. Unified runs list is generally available

    Replaces separate job and pipeline run lists, adds filtering and error code visualization.

  32. Spark Declarative Pipelines on Lakeflow sinks are now generally available

    Supports writing to Delta tables, Kafka topics, and Azure Event Hubs.

  33. Databricks SQL alerts are now generally available

    Monitors data and KPIs by running scheduled queries, notifying recipients when conditions are met.

  34. Lakeflow Pipelines Editor is now generally available

    Offers agent-first experience with Genie Code for creating production pipelines.

  35. Disabling tasks in Lakeflow Jobs is now GA

    Disabled tasks retain config and run history, can be re-enabled later.

  36. ai_parse_document is now generally available

    Parses structured content from unstructured documents, limited to 500 pages and 100 MB.

  37. C5, TISAX, and K-FSI compliance controls are now generally available

    Available on Azure, providing enhancements for workspace compliance requirements.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  38. Scoped personal access tokens are now generally available

    Restrict tokens to specific API operations with specified permissions. Coming soon to compliance security profile workspaces.

  39. Customer-managed keys for Unity Catalog are generally available

    Encrypts data in Unity Catalog catalogs using cloud KMS keys. Requires default storage.

    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  40. Update workspace network configuration to VNet injection is now GA

    Migrates from Databricks-managed VNet to customer-owned VNet.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  41. Azure virtual network service endpoint policies are now generally available

    Apply to classic compute for outbound storage access filtering. Requires configuration.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  42. COMMENT ON streaming tables is now GA

    Adds comments to streaming tables, previously only available for non-streaming tables.

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.