Skip to content

Databricks releases, every cloud

14 releases of 1321

Last updated

  1. Python UDTFs in Unity Catalog are now generally available

    Runs on serverless compute, classic compute, and SQL warehouses. Requires Databricks Runtime 18.

  2. Automated setup for S3 external locations

    Uses AWS IAM temporary delegation to configure external locations and provision required resources.

    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  3. Scala and Java UDFs in Unity Catalog are now generally available

    Reuses existing JVM logic, offers better performance than Python UDFs.

  4. Data Classification is now available by default for additional compliance standards

    Requires compliance security profile with C5, TISAX, or IRAP controls.

  5. Parquet v2 for Delta Lake tables is generally available

    Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.

  6. Data Classification is now available by default for some workspaces with the compliance security profile enabled

    Requires compliance security profile and specific controls like HIPAA or HITRUST.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Auto time-to-live for automatic row deletion is generally available

    Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.

  9. Converting a partitioned table to liquid clustering is generally available

    Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.

  10. External lineage is now generally available

    Registers external assets like Salesforce or MySQL sources and Tableau dashboards. Automatically records source lineage for Lakeflow Connect pipelines.

  11. Column popularity is now available in the Catalog Explorer

    Shows column query count in the Overview tab, determined by read queries.

  12. Unity Catalog managed Apache Iceberg tables, foreign Apache Iceberg tables, and Apache Iceberg v3 features are generally available

    Supports liquid clustering, predictive optimization, and materialized views. Requires Databricks Runtime or external Iceberg-compatible engines.

  13. Catalog commits are now generally available

    Enables multi-statement transactions on Unity Catalog managed Delta tables, supported by products like MLflow and Delta Sharing.

  14. Governed tags are generally available

    Allow administrators to define controlled tags for Unity Catalog and workspace objects, enforcing consistent metadata tagging.

  15. ABAC policy functions now use snake_case naming

    Replaces camelCase with snake_case, old forms still work but will be deprecated.

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.