Databricks releases, every cloud
- Data Classification now scans Unity Catalog views (Beta)
Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.
- Data Classification is now available by default for additional compliance standards
Requires compliance security profile with C5, TISAX, or IRAP controls.
- Data Classification is now available by default for some workspaces with the compliance security profile enabled
Requires compliance security profile and specific controls like HIPAA or HITRUST.
- Reorganized Spark Declarative Pipelines on Lakeflow documentation
Conceptual topics are now under Concepts.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Graviton instance types are available for the compliance security profile
Graviton instances improve price-performance for many workloads on AWS Commercial workspaces with FedRAMP Moderate, IRAP, or CCCS Medium compliance standards.
- Databricks Data Classification is now GA
Automatically classifies and tags sensitive data in Unity Catalog using AI.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon
Deletes now retain associated tables by default, set cascade=true to remove them.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks Documentation site table of contents tabs
Replaces static sidebar with tabbed navigation, includes 6 context tabs.
- ISMAP compliance support
Supports Japanese government cloud certification, requires configuration changes.
- Change to use_case field in VPC endpoint API responses Coming soon
Changes from WORKSPACE_ACCESS to GENERAL_ACCESS, see API docs for details.
- Expanded regional availability for C5 and TISAX compliance
Now available in all regions and with serverless compute.
- TISAX compliance controls
Enhances workspace compliance based on ISO/IEC 27001 and VDA ISA.
- Data Classification (Public Preview)
Supports all catalog types, consolidates results into a system table.
- Data classification system table Beta
Captures sensitive data detections at column level across enabled catalogs.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.