Databricks releases, every cloud
- Reorganized Spark Declarative Pipelines on Lakeflow documentation
Conceptual topics are now under Concepts.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Graviton instance types are available for the compliance security profile
Graviton instances improve price-performance for many workloads on AWS Commercial workspaces with FedRAMP Moderate, IRAP, or CCCS Medium compliance standards.
- C5, TISAX, and K-FSI compliance controls are now generally available
Available on Azure, providing enhancements for workspace compliance requirements.
- Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon
Deletes now retain associated tables by default, set cascade=true to remove them.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks Documentation site table of contents tabs
Replaces static sidebar with tabbed navigation, includes 6 context tabs.
- ISMAP compliance support
Supports Japanese government cloud certification, requires configuration changes.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Change to use_case field in VPC endpoint API responses Coming soon
Changes from WORKSPACE_ACCESS to GENERAL_ACCESS, see API docs for details.
- Enhanced Security and Compliance add-on is now generally available
includes compliance security profile and enhanced security monitoring.
- File events enabled by default on new external locations
Enabled on new locations, detects file changes for storage jobs and pipelines, can be disabled after creation.
- Discover files in Auto Loader efficiently using file events
Requires file events enabled on external locations. Replaces directory listing for efficiency.
- Expanded regional availability for C5 and TISAX compliance
Now available in all regions and with serverless compute.
- SFTP connector (Public Preview)
Extends Auto Loader to ingest files from SFTP servers.
- TISAX compliance controls (Public Preview)
Enhances workspace compliance based on ISO/IEC 27001 and VDA ISA requirements.
- TISAX compliance controls
Enhances workspace compliance based on ISO/IEC 27001 and VDA ISA.
- Serverless compute resources now support PCI-DSS compliance in australia-east
Supports PCI-DSS v4.0 in australia-east region.
- Discover files in Auto Loader efficiently using file events without enrollment (Public Preview)
Requires file events enabled on external locations.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.