Databricks releases, every cloud
- Data Classification now scans Unity Catalog views (Beta)
Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.
- External secrets in Unity Catalog (Beta)
Connects Unity Catalog schema to AWS Secrets Manager, appearing as read-only objects.
- Unity Catalog Skills (Beta)
Publishes and governs agent skills, controlling access with Unity Catalog permissions.
- Context attributes in ABAC column mask and row filter policies (Beta)
Targets request context, such as OAuth client ID and on-behalf-of status, in Unity Catalog policies.
- Identity attributes in ABAC column mask policies (Beta)
Targets users by attributes like department or country, using has_identity_attribute_value and has_identity_attribute_tag_match functions.
- Tags page in Governance Hub (Beta)
Provides a centralized view of tag usage, summarizes governed tags, and offers recommendations for invalid values. Requires account admins to enable from Previews page.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Define business concepts with Pages (Beta)
Gives business terms a single governed definition, part of Unity Catalog semantics.
- READ METADATA privilege is GA
Provides read-only visibility into security-sensitive metadata, including privilege grants and ABAC policies.
- Tag automations (Beta)
Assigns or removes governed tags on Unity Catalog tables or volumes based on defined conditions.
- Genie One is now available in Google Sheets
Queries governed data in natural language, importing results as native rows and columns.
- Genie One is now available in Microsoft Excel
Queries governed data in natural language, importing results as native rows and columns.
- Refresh materialized views and streaming tables without exempting the pipeline owner from ABAC policies
Pipeline owners are now subject to ABAC policies when refreshing views and tables. Policies are evaluated using the pipeline owner's identity.
- Secrets in Unity Catalog is GA
Stores secrets as securable objects with Unity Catalog privileges. Uses catalog.schema.secret namespace.
- Upcoming general availability of Unity Gateway Coming soon
Extends Unity Catalog governance to runtime interactions, controls AI service usage, and monitors traffic. Available by default for workspaces with compliance security profile in mid-September.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Automated setup for S3 external locations
Uses AWS IAM temporary delegation to configure external locations and provision required resources.
- Databricks-hosted sample datasets available in the samples catalog
Available in Unity Catalog-enabled workspaces through OpenSharing as samples.databricks.datasets.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Govern LLMs in Unity Catalog with model services (Beta)
Represents a governed LLM endpoint, sharable across workspaces via Unity Catalog privileges.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Comments on foreign tables (Beta)
Syncs table and column comments from external data sources to Unity Catalog foreign tables.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- ABAC GRANT policies for models (Beta)
Grants EXECUTE privilege on models based on governed tags, supporting MLflow and foundation models.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Genie Code now supports auto-approve for tool actions
Approves tool actions without prompts, using an AI classifier to block risky ones.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Write data from Microsoft Excel back to Azure Databricks
Writes to Unity Catalog tables, overwriting existing ones if needed.
- Write data from Microsoft Excel back to Databricks
Writes to Unity Catalog tables, overwriting existing ones if needed.
- Column popularity is now available in the Catalog Explorer
Shows column query count in the Overview tab, determined by read queries.
- Cross-engine attribute-based access controls (Beta)
Enforces row filters and column masks server-side for external engines reading Unity Catalog tables.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Azure Databricks Add-in for Excel support for all compliance security profile standards
Supports all Azure Databricks compliance security profiles.
- Databricks Add-in for Excel support for all compliance security profile standards
Supports all Databricks compliance security profiles. Requires Public Preview.
- Publish a Unity Catalog catalog to Microsoft Fabric (Beta)
Creates a read-only mirrored catalog, allowing Fabric users to query Unity Catalog tables without data movement.
- View run history for scheduled refreshes in Google Sheets
Shows Run ID, start time, and success status for each run.
- HIPAA support for the Azure Databricks Add-in for Excel
Available for workspaces with HIPAA compliance across all supported regions. Requires a workspace with HIPAA compliance enabled.
- HIPAA support for the Databricks Add-in for Excel
Available for workspaces with HIPAA compliance across all supported regions.
- Tag Unity Catalog functions
Requires Databricks Runtime 18.1 or above. Uses SET TAG and UNSET TAG commands.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Recently Resolved Incidents section in Data Quality Monitoring (Beta)
Shows automatically recovered unhealthy tables, including resolution time.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Azure Databricks Excel Add-in requires workspace preview enablement
Enabled from the Previews page by a workspace admin.
- Databricks Excel Add-in requires workspace preview enablement
Enabled from the Previews page by a workspace admin.
- Language selector for AI-generated comments in Catalog Explorer
Saves selection in browser's local storage, applying to all entity types.
- Create and write to Unity Catalog tables from external Delta clients (Beta)
Requires catalog-managed commits to be enabled, supports Apache Spark clients.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Connect Lovable apps to Azure Databricks
Uses REST API and OAuth authentication. Requires machine-to-machine authentication setup.
- Connect Lovable apps to Databricks
Uses REST API and OAuth machine-to-machine authentication.
- SQL reference documentation for managing governed tags
Adds 5 SQL statements: CREATE, ALTER, DROP, DESCRIBE, SHOW.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Workspace skills for Genie Code are now available
Workspace admins can create shared skills for machine learning pipelines and domain-specific processes.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.