Databricks releases, every cloud
- Automated setup for S3 external locations
Uses AWS IAM temporary delegation to configure external locations and provision required resources.
- Scala and Java UDFs in Unity Catalog are now generally available
Reuses existing JVM logic, offers better performance than Python UDFs.
- Parquet v2 for Delta Lake tables is generally available
Requires Databricks Runtime 18.1 and above, set delta.parquet.format.version to 2.12.0.
- Auto time-to-live for automatic row deletion is generally available
Deletes rows from Delta Lake, Iceberg, and streaming tables based on a DATE or TIMESTAMP column.
- Converting a partitioned table to liquid clustering is generally available
Uses ALTER TABLE command, requires Databricks Runtime 18.1 or above.
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.