Databricks releases, every cloud
- Reorganized Spark Declarative Pipelines on Lakeflow documentation
Conceptual topics are now under Concepts.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Graviton instance types are available for the compliance security profile
Graviton instances improve price-performance for many workloads on AWS Commercial workspaces with FedRAMP Moderate, IRAP, or CCCS Medium compliance standards.
- Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon
Deletes now retain associated tables by default, set cascade=true to remove them.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks Documentation site table of contents tabs
Replaces static sidebar with tabbed navigation, includes 6 context tabs.
- ISMAP compliance support
Supports Japanese government cloud certification, requires configuration changes.
- Change to use_case field in VPC endpoint API responses Coming soon
Changes from WORKSPACE_ACCESS to GENERAL_ACCESS, see API docs for details.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- File events enabled by default on new external locations
Enabled on new locations, detects file changes for storage jobs and pipelines, can be disabled after creation.
- Discover files in Auto Loader efficiently using file events
Requires file events enabled on external locations. Replaces directory listing for efficiency.
- Expanded regional availability for C5 and TISAX compliance
Now available in all regions and with serverless compute.
- SFTP connector (Public Preview)
Extends Auto Loader to ingest files from SFTP servers.
- TISAX compliance controls
Enhances workspace compliance based on ISO/IEC 27001 and VDA ISA.
- Discover files in Auto Loader efficiently using file events without enrollment (Public Preview)
Requires file events enabled on external locations.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.