Skip to content

Databricks releases, every cloud

48 releases of 1321

Last updated

  1. Data Classification now scans Unity Catalog views (Beta)

    Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.

  2. External secrets in Unity Catalog (Beta)

    Connects Unity Catalog schema to AWS Secrets Manager, appearing as read-only objects.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  3. Unity Catalog Skills (Beta)

    Publishes and governs agent skills, controlling access with Unity Catalog permissions.

  4. Inbound Private Service Connect for performance-intensive services (Beta)

    Enables private connectivity to services like Zerobus Ingest and Lakebase Autoscaling on Google Cloud.

    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  5. Context attributes in ABAC column mask and row filter policies (Beta)

    Targets request context, such as OAuth client ID and on-behalf-of status, in Unity Catalog policies.

  6. Identity attributes in ABAC column mask policies (Beta)

    Targets users by attributes like department or country, using has_identity_attribute_value and has_identity_attribute_tag_match functions.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Cross-workspace access for serverless (Beta)

    Controls serverless network traffic between workspaces with ingress and egress rules.

  9. Custom URL access to workspaces over inbound Private Link (Beta)

    Uses general_access private endpoint, serves workspaces and account-level resources across regions.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  10. Tags page in Governance Hub (Beta)

    Provides a centralized view of tag usage, summarizes governed tags, and offers recommendations for invalid values. Requires account admins to enable from Previews page.

  11. Define business concepts with Pages (Beta)

    Gives business terms a single governed definition, part of Unity Catalog semantics.

  12. READ METADATA privilege is GA

    Provides read-only visibility into security-sensitive metadata, including privilege grants and ABAC policies.

  13. Tag automations (Beta)

    Assigns or removes governed tags on Unity Catalog tables or volumes based on defined conditions.

  14. Refresh materialized views and streaming tables without exempting the pipeline owner from ABAC policies

    Pipeline owners are now subject to ABAC policies when refreshing views and tables. Policies are evaluated using the pipeline owner's identity.

  15. Secrets in Unity Catalog is GA

    Stores secrets as securable objects with Unity Catalog privileges. Uses catalog.schema.secret namespace.

  16. Upcoming general availability of Unity Gateway Coming soon

    Extends Unity Catalog governance to runtime interactions, controls AI service usage, and monitors traffic. Available by default for workspaces with compliance security profile in mid-September.

  17. Automated setup for S3 external locations

    Uses AWS IAM temporary delegation to configure external locations and provision required resources.

    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  18. Databricks-hosted sample datasets available in the samples catalog

    Available in Unity Catalog-enabled workspaces through OpenSharing as samples.databricks.datasets.

  19. Networking charges for performance-intensive products

    Charges apply to cross-region and public-internet egress for Lakebase, OpenSharing SecureConnect, Zerobus, and Files API.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP, read it on their docs
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Allowlist partner platform IPs in context-based ingress control (Beta)

    Supports Power BI, Tableau Cloud, and dbt platform, with automatic IP list updates.

  22. Serverless compute is now available in the Azure UK West region

    Supports notebooks, jobs, pipelines, and SQL warehouses, with private connectivity.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP, read it on their docs
  23. Govern LLMs in Unity Catalog with model services (Beta)

    Represents a governed LLM endpoint, sharable across workspaces via Unity Catalog privileges.

  24. Comments on foreign tables (Beta)

    Syncs table and column comments from external data sources to Unity Catalog foreign tables.

  25. Private Link for account-level resources (Beta)

    Connects account console through VPC interface endpoint instead of public internet. Requires configuration.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  26. ABAC GRANT policies for models (Beta)

    Grants EXECUTE privilege on models based on governed tags, supporting MLflow and foundation models.

  27. Column popularity is now available in the Catalog Explorer

    Shows column query count in the Overview tab, determined by read queries.

  28. Cross-engine attribute-based access controls (Beta)

    Enforces row filters and column masks server-side for external engines reading Unity Catalog tables.

  29. Azure UK South now has a dedicated regional control plane

    New workspaces require firewall allowlist entries for SCC relay tunnel and other IPs. Existing workspaces use UK West control plane unless migrated.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP, read it on their docs
  30. Connect Azure Databricks to on-premises resources using an SSH reverse tunnel

    Replaces inbound firewall access, works with classic and serverless compute.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  31. Connect Databricks to on-premises resources using an SSH reverse tunnel

    Uses proxy VMs in AWS, replacing inbound firewall access.

    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  32. Tag Unity Catalog functions

    Requires Databricks Runtime 18.1 or above. Uses SET TAG and UNSET TAG commands.

  33. Recently Resolved Incidents section in Data Quality Monitoring (Beta)

    Shows automatically recovered unhealthy tables, including resolution time.

  34. Language selector for AI-generated comments in Catalog Explorer

    Saves selection in browser's local storage, applying to all entity types.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  35. Create and write to Unity Catalog tables from external Delta clients (Beta)

    Requires catalog-managed commits to be enabled, supports Apache Spark clients.

  36. SQL reference documentation for managing governed tags

    Adds 5 SQL statements: CREATE, ALTER, DROP, DESCRIBE, SHOW.

  37. Create alerts for anomaly detection in the Data Quality Monitoring UI (Beta)

    Creates notifications for unusual data patterns, available in Beta.

  38. ABAC policy functions now use snake_case naming

    Replaces camelCase with snake_case, old forms still work but will be deprecated.

  39. Data quality monitoring documentation moved to Data governance (Unity Catalog)

    Moved from Data guides to Data governance chapter.

  40. Customer-managed keys for Unity Catalog

    Uses own encryption keys for Unity Catalog data. Replaces automatic encryption.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  41. Customer-managed keys for Unity Catalog (Beta)

    Uses own encryption keys for Unity Catalog catalogs. Replaces automatic encryption.

    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  42. Discover page and domains (Beta)

    Groups data assets by functional area, built on governed tags.

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.