Databricks releases, every cloud
- Reorganized Spark Declarative Pipelines on Lakeflow documentation
Conceptual topics are now under Concepts.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon
Deletes now retain associated tables by default, set cascade=true to remove them.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks Documentation site table of contents tabs
Replaces static sidebar with tabbed navigation, includes 6 context tabs.
- Change to use_case field in VPC endpoint API responses Coming soon
Changes from WORKSPACE_ACCESS to GENERAL_ACCESS, see API docs for details.
- File events enabled by default on new external locations
Enabled on new locations, detects file changes for storage jobs and pipelines, can be disabled after creation.
- Discover files in Auto Loader efficiently using file events
Requires file events enabled on external locations. Replaces directory listing for efficiency.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- SFTP connector (Public Preview)
Extends Auto Loader to ingest files from SFTP servers.
- Discover files in Auto Loader efficiently using file events without enrollment (Public Preview)
Requires file events enabled on external locations.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.