Databricks releases, every cloud
- Upcoming general availability of Unity Gateway Coming soon
Extends Unity Catalog governance to runtime interactions, controls AI service usage, and monitors traffic. Available by default for workspaces with compliance security profile in mid-September.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Governed tags system table is in Beta
Contains records for each governed tag key, including customer-created and system-generated tags.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks-hosted sample datasets available in the samples catalog
Available in Unity Catalog-enabled workspaces through OpenSharing as samples.databricks.datasets.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Role-based access control (RBAC) is in Public Preview
Lets users assume a role with limited permissions. Requires account and workspace admin setup.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - MLflow trace storage in Unity Catalog is now generally available
Stores traces in OpenTelemetry format with unlimited storage and SQL query access.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Request for Access will soon be enabled by default for all workspaces Coming soon
Routes requests to Unity Catalog object owners via email, replacing workspace-level settings.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Secrets in Unity Catalog (Public Preview)
Uses three-level namespace and Unity Catalog privileges for access control.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Restrict access to AI Functions with Unity Catalog permissions (Public Preview)
Requires account team enablement, restricts access to task-specific AI Functions.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Govern LLMs in Unity Catalog with model services (Beta)
Represents a governed LLM endpoint, sharable across workspaces via Unity Catalog privileges.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Enable access requests across your Unity Catalog metastore (Public Preview)
Enables requests at metastore level, inherited by all catalogs and schemas.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - The Discover page is now in Public Preview
Helps find Unity Catalog data assets without requiring catalog hierarchy knowledge. Organizes tables and dashboards by business area.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Comments on foreign tables (Beta)
Syncs table and column comments from external data sources to Unity Catalog foreign tables.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - OneLake catalog federation is generally available
Allows reading OneLake data without copying, with read-only access and direct queries against file storage.
- Configure the recovery period for dropped managed tables (Public Preview)
Sets recovery period to 0 hours or 7-30 days, requires Databricks Runtime 17.3.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Databricks-to-Databricks Delta Sharing across regulatory domains is now available (Public Preview)
Supports sharing with AWS GovCloud, AWS GovCloud DoD, and Azure China.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - ABAC GRANT policies for models (Beta)
Grants EXECUTE privilege on models based on governed tags, supporting MLflow and foundation models.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Automatic identity management for Okta (Public Preview)
Syncs Okta users and groups without SCIM provisioning. Requires identity federated workspaces.
- Cross-engine attribute-based access controls (Beta)
Enforces row filters and column masks server-side for external engines reading Unity Catalog tables.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
- Account access denylist for automatic identity management (Public Preview)
Blocks access for specified users, groups, or service principals. Applies to AWS and GCP accounts with automatic identity management.
- MLflow trace storage in Unity Catalog is now in Public Preview
Stores OpenTelemetry traces, governed by Unity Catalog permissions, queryable from Databricks SQL or MLflow Python SDK.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Attribute-based access control (ABAC) is now generally available
Uses governed tags to enforce row filter and column mask policies. Replaces per-table configuration with automatic application at catalog, schema, or table level.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Tag Unity Catalog functions
Requires Databricks Runtime 18.1 or above. Uses SET TAG and UNSET TAG commands.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Recently Resolved Incidents section in Data Quality Monitoring (Beta)
Shows automatically recovered unhealthy tables, including resolution time.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Language selector for AI-generated comments in Catalog Explorer
Saves selection in browser's local storage, applying to all entity types.
- Databricks Data Classification is now GA
Automatically classifies and tags sensitive data in Unity Catalog using AI.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Altering a catalog or schema's managed storage location is now GA
Modifies default cloud storage location for new managed tables and volumes.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Create and write to Unity Catalog tables from external Delta clients (Beta)
Requires catalog-managed commits to be enabled, supports Apache Spark clients.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - SQL reference documentation for managing governed tags
Adds 5 SQL statements: CREATE, ALTER, DROP, DESCRIBE, SHOW.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Customer-managed keys for Unity Catalog are generally available
Encrypts data in Unity Catalog catalogs using cloud KMS keys. Requires default storage.
- Create alerts for anomaly detection in the Data Quality Monitoring UI (Beta)
Creates notifications for unusual data patterns, available in Beta.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Health indicators for tables in Catalog Explorer (Public Preview)
Shows freshness and completeness status based on anomaly detection.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Data quality monitoring documentation moved to Data governance (Unity Catalog)
Moved from Data guides to Data governance chapter.
AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud) - Customer-managed keys for Unity Catalog
Uses own encryption keys for Unity Catalog data. Replaces automatic encryption.
- Customer-managed keys for Unity Catalog (Beta)
Uses own encryption keys for Unity Catalog catalogs. Replaces automatic encryption.
- Customer-managed keys for Unity Catalog (Public Preview)
Protects data with user-owned encryption keys, replacing automatic encryption.
Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.