Databricks releases, every cloud
- SQL alert task in Lakeflow Jobs is now available by default for workspaces with the compliance security profile enabled
Supports all Databricks compliance security profile standards, returns evaluation state as output.
- Zerobus Ingest is now enabled by default for workspaces with the compliance security profile
Replaces manual connector setup for compliant workspaces.
- Data Classification is now available by default for additional compliance standards
Requires compliance security profile with C5, TISAX, or IRAP controls.
- Query-based connectors in Lakeflow Connect will soon be available by default for workspaces with the compliance security profile enabled Coming soon
Replaces CDC configuration, supports Oracle, Teradata, and others.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks SQL alerts are now available by default for workspaces with the compliance security profile enabled
Supports all compliance security profile standards, monitors data and KPIs via scheduled queries.
- Behavior changes for continuous jobs and pipelines Coming soon
Configures continuous schedule from pipeline page, wrapping pipeline in a continuous job. Replaces pipeline's built-in continuous setting for new pipelines.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Excel file format support is now available by default
Supports .xls, .xlsx, and .xlsm files without external libraries.
- Data Classification is now available by default for some workspaces with the compliance security profile enabled
Requires compliance security profile and specific controls like HIPAA or HITRUST.
- Upcoming breaking change: default behavior when deleting a Unity Catalog pipeline Coming soon
Deletes now retain associated tables by default, set cascade=true to remove them.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - File events enabled by default on new external locations
Enabled on new locations, detects file changes for storage jobs and pipelines, can be disabled after creation.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.