Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

47 releases of 1348

Last updated

  1. Scala UDFs can access Unity Catalog secrets

    They use the caller's or function owner's permissions. Requires environment version 6 or Databricks Runtime 19.

    #Unity Catalog
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  2. VARIANT cast extends to ARRAY and MAP columns in ABAC column masks

    Requires Databricks Runtime 19 or above. Supports ARRAY and MAP in addition to STRUCT.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  3. Data Classification now scans Unity Catalog views (Beta)

    Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.

    #Data Classification#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. External secrets in Unity Catalog (Beta)

    Connects Unity Catalog schema to AWS Secrets Manager, appearing as read-only objects.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  5. Unity Catalog Skills (Beta)

    Publishes and governs agent skills, controlling access with Unity Catalog permissions.

    #Databricks AI#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. Context attributes in ABAC column mask and row filter policies (Beta)

    Targets request context, such as OAuth client ID and on-behalf-of status, in Unity Catalog policies.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Identity attributes in ABAC column mask policies (Beta)

    Targets users by attributes like department or country, using has_identity_attribute_value and has_identity_attribute_tag_match functions.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Tags page in Governance Hub (Beta)

    Provides a centralized view of tag usage, summarizes governed tags, and offers recommendations for invalid values. Requires account admins to enable from Previews page.

    #Administration#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. Define business concepts with Pages (Beta)

    Gives business terms a single governed definition, part of Unity Catalog semantics.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  11. READ METADATA privilege is GA

    Provides read-only visibility into security-sensitive metadata, including privilege grants and ABAC policies.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  12. Tag automations (Beta)

    Assigns or removes governed tags on Unity Catalog tables or volumes based on defined conditions.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  13. Refresh materialized views and streaming tables without exempting the pipeline owner from ABAC policies

    Pipeline owners are now subject to ABAC policies when refreshing views and tables. Policies are evaluated using the pipeline owner's identity.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  14. Secrets in Unity Catalog is GA

    Stores secrets as securable objects with Unity Catalog privileges. Uses catalog.schema.secret namespace.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  15. Upcoming general availability of Unity Gateway Coming soon

    Extends Unity Catalog governance to runtime interactions, controls AI service usage, and monitors traffic. Available by default for workspaces with compliance security profile in mid-September.

    #Databricks AI#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  16. Automated setup for S3 external locations

    Uses AWS IAM temporary delegation to configure external locations and provision required resources.

    #Storage#Unity Catalog
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP, read it on their docs
  17. Databricks-hosted sample datasets available in the samples catalog

    Available in Unity Catalog-enabled workspaces through OpenSharing as samples.databricks.datasets.

    #Delta Sharing#Unity Catalog Catalog, schema, table, volume
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  18. Custom Docker images for AI Runtime CLI workloads (Beta)

    Allows custom system library versions and complex dependencies, requires setup via Use custom Docker images.

    #Machine Learning
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  19. Govern LLMs in Unity Catalog with model services (Beta)

    Represents a governed LLM endpoint, sharable across workspaces via Unity Catalog privileges.

    #AI#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Comments on foreign tables (Beta)

    Syncs table and column comments from external data sources to Unity Catalog foreign tables.

    #Lakehouse Federation#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  22. AI Runtime CLI (Beta)

    Submits and manages distributed training workloads on serverless GPU compute from a local machine.

    #Machine Learning
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  23. ABAC GRANT policies for models (Beta)

    Grants EXECUTE privilege on models based on governed tags, supporting MLflow and foundation models.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  24. Reorganized Spark Declarative Pipelines on Lakeflow documentation

    Conceptual topics are now under Concepts.

    #Documentation#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  25. Column popularity is now available in the Catalog Explorer

    Shows column query count in the Overview tab, determined by read queries.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  26. Cross-engine attribute-based access controls (Beta)

    Enforces row filters and column masks server-side for external engines reading Unity Catalog tables.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  27. Serve custom LLMs with Custom Model Serving (Beta)

    Supports multimodal models and PEFT recipes, unlike Foundation Model APIs.

    #Machine Learning#Model Serving
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  28. Tag Unity Catalog functions

    Requires Databricks Runtime 18.1 or above. Uses SET TAG and UNSET TAG commands.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  29. Recently Resolved Incidents section in Data Quality Monitoring (Beta)

    Shows automatically recovered unhealthy tables, including resolution time.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  30. Language selector for AI-generated comments in Catalog Explorer

    Saves selection in browser's local storage, applying to all entity types.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  31. AI Runtime 1xH100 accelerator (Beta)

    Supports 1xH100 accelerator, see Hardware options for details.

    #Machine Learning
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  32. Create and write to Unity Catalog tables from external Delta clients (Beta)

    Requires catalog-managed commits to be enabled, supports Apache Spark clients.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  33. SQL reference documentation for managing governed tags

    Adds 5 SQL statements: CREATE, ALTER, DROP, DESCRIBE, SHOW.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  34. Databricks Documentation site table of contents tabs

    Replaces static sidebar with tabbed navigation, includes 6 context tabs.

    #Documentation
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  35. Create alerts for anomaly detection in the Data Quality Monitoring UI (Beta)

    Creates notifications for unusual data patterns, available in Beta.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  36. ABAC policy functions now use snake_case naming

    Replaces camelCase with snake_case, old forms still work but will be deprecated.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP, read it on their docs
  37. Data quality monitoring documentation moved to Data governance (Unity Catalog)

    Moved from Data guides to Data governance chapter.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(not on this cloud)
  38. Declarative Feature Engineering APIs (Beta)

    Define time-windowed aggregation features from data sources, materialize to Delta tables or Lakebase. Available in us-east-1 and us-west-2 regions.

    #Machine Learning
    AWS, read it on their docsAzure(not on this cloud)GCP(not on this cloud)SAP(not on this cloud)
  39. Endpoint telemetry for custom model serving endpoints (Beta)

    Stores logs, traces, and metrics in Unity Catalog Delta tables using OpenTelemetry.

    #Machine Learning#Model Serving
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  40. Customer-managed keys for Unity Catalog

    Uses own encryption keys for Unity Catalog data. Replaces automatic encryption.

    #Security#Unity Catalog
    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  41. Customer-managed keys for Unity Catalog (Beta)

    Uses own encryption keys for Unity Catalog catalogs. Replaces automatic encryption.

    #Security#Unity Catalog
    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(not on this cloud)
  42. Change to use_case field in VPC endpoint API responses Coming soon

    Changes from WORKSPACE_ACCESS to GENERAL_ACCESS, see API docs for details.

    #API
    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.

We measure how the site is used. PostHog and Google Analytics, set to measurement only with advertising features off. We do not sell your data or share it for advertising, and you can turn this off. What this stores.