Skip to content

Databricks releases, every cloud

28 releases of 1321

Last updated

  1. Python UDTFs in Unity Catalog are now generally available

    Runs on serverless compute, classic compute, and SQL warehouses. Requires Databricks Runtime 18.

  2. Email notifications for expiring service principal tokens are now generally available

    Sends emails to workspace admins 7 days before token expiration for used tokens with lifetime over 7 days. No configuration is required.

  3. Transactions are now generally available

    Require catalog commits enabled on participating tables. Use BEGIN ATOMIC or BEGIN TRANSACTION syntax.

  4. Variant and Variant shredding are now generally available

    Requires Databricks Runtime 17.3, recommended 18.1 for optimal performance.

  5. Context-based ingress control for workspaces public access is now generally available

    Uses allow and deny rules to control access based on identities, network sources, and request types.

  6. Scala and Java UDFs in Unity Catalog are now generally available

    Reuses existing JVM logic, offers better performance than Python UDFs.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. AI Search High QPS is now generally available

    Sets target QPS on standard endpoints for high-throughput workloads. Existing endpoints are not affected.

  9. Budgets are now generally available

    Define spending thresholds with optional per-user overrides and actions like email alerts.

  10. Okta support for automatic identity management is now generally available

    Lets you sync users and groups from Okta without SCIM provisioning.

  11. Parquet v2 for Delta Lake tables is generally available

    Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.

  12. ai_query is now generally available

    Lets you query AI models from SQL or Python.

  13. Auto time-to-live for automatic row deletion is generally available

    Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.

  14. Converting a partitioned table to liquid clustering is generally available

    Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.

  15. ai_classify is now generally available

    Classifies text content according to custom labels with support for multi-label classification.

  16. ai_extract is now generally available

    Extracts structured data from text and documents according to a provided schema. Supports nested objects and arrays.

  17. Endpoint telemetry for custom model serving endpoints is generally available

    Persists OpenTelemetry logs, traces, and metrics to Unity Catalog tables.

  18. External lineage is now generally available

    Registers external assets like Salesforce or MySQL sources and Tableau dashboards. Automatically records source lineage for Lakeflow Connect pipelines.

  19. Inbound Private Link for performance-intensive services is now generally available

    Supports Lakebase Autoscaling and Zerobus Ingest.

    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Foundation model Unity Catalog permissions is generally available

    Requires account team enablement, controls access to system.ai schema.

  22. Automatic identity management with Microsoft Entra ID is now GA

    Replaces SCIM provisioning, syncs users and groups from Microsoft Entra ID.

  23. Databricks CLI is now GA

    Stores U2M tokens in OS-native secure storage.

  24. Unity Catalog managed Apache Iceberg tables, foreign Apache Iceberg tables, and Apache Iceberg v3 features are generally available

    Supports liquid clustering, predictive optimization, and materialized views. Requires Databricks Runtime or external Iceberg-compatible engines.

  25. Databricks SQL alerts are now generally available

    Monitors data and KPIs by running scheduled queries, notifying recipients when conditions are met.

  26. Catalog commits are now generally available

    Enables multi-statement transactions on Unity Catalog managed Delta tables, supported by products like MLflow and Delta Sharing.

  27. Governed tags are generally available

    Allow administrators to define controlled tags for Unity Catalog and workspace objects, enforcing consistent metadata tagging.

  28. SAP Databricks usage dashboard is now generally available

    Account admins can import pre-built dashboards to monitor usage at account and workspace levels.

    AWS(not on this cloud)Azure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  29. Lakebase is now generally available with compliance security profile

    Requires HIPAA, C5, TISAX, or None compliance standard.

  30. Lakebase is now generally available on Azure

    Adds autoscaling compute and scale-to-zero to 11 new Azure regions.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP, read it on their docs

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.