Skip to content

Databricks releases, every cloud

All GAPreviewBehavior changeDeprecationUpdate

136 releases of 1321

Last updated

  1. Data Classification now scans Unity Catalog views (Beta)

    Scans Unity Catalog views in addition to tables, using the same detection engine, and is currently in Beta.

    #Data Classification#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  2. JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon

    Replaces cluster provisioning, available in Lakeflow Jobs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  3. Standard performance mode is now available for one-time runs in the Jobs API

    Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.

    #Lakeflow#Serverless
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  4. Maintenance windows for continuous pipelines

    Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  5. Managed tables in Lakeflow pipelines (Beta)

    Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  6. Anaplan connector (Beta)

    Ingests Anaplan audit trail events and user account records into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Anysphere Organization connector (Beta)

    Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  9. Celigo connector (Beta)

    Ingests Celigo audit log events into Databricks using an API token.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  10. External secrets in Unity Catalog (Beta)

    Connects Unity Catalog schema to AWS Secrets Manager, appearing as read-only objects.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  11. Unity Catalog Skills (Beta)

    Publishes and governs agent skills, controlling access with Unity Catalog permissions.

    #Databricks AI#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  12. Atlassian Audit Logs connector (Beta)

    Ingests Atlassian organization audit log events using an API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  13. Genie Code is now available as a Lakeflow Jobs task (Beta)

    Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.

    #Genie Code#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  14. Anysphere Audit Logs connector (Beta)

    Uses Anysphere Admin API to ingest audit-log events, requires Cursor Admin API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  15. Verkada connector (Beta)

    Ingests Verkada organization audit logs and access users using a Verkada API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  16. Context attributes in ABAC column mask and row filter policies (Beta)

    Targets request context, such as OAuth client ID and on-behalf-of status, in Unity Catalog policies.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  17. Default Python package repositories are GA for Lakeflow pipelines and classic compute

    Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.

    #Compute#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  18. Performance mode now applies to materialized view and streaming table refreshes from dbt tasks

    Now applies to dbt tasks, with optional Standard mode for lower costs, increasing latency to 4-6 minutes.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  19. Identity attributes in ABAC column mask policies (Beta)

    Targets users by attributes like department or country, using has_identity_attribute_value and has_identity_attribute_tag_match functions.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Workiva connector (Beta)

    Ingests Workiva audit activity, users, and roles using OAuth2 client credentials.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  22. Gmail connector in Lakeflow Connect (Beta)

    Ingests messages, labels, drafts, filters, and profile data using a Google service account.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  23. SendGrid connector (Beta)

    Ingests SendGrid subuser directory and IP access activity using a parent-account API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  24. Tags page in Governance Hub (Beta)

    Provides a centralized view of tag usage, summarizes governed tags, and offers recommendations for invalid values. Requires account admins to enable from Previews page.

    #Administration#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  25. Amplitude connector (Beta)

    Ingests product analytics event data with metadata from Amplitude.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  26. Define business concepts with Pages (Beta)

    Gives business terms a single governed definition, part of Unity Catalog semantics.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  27. Glean connector in Lakeflow Connect (Beta)

    Ingests company-wide usage insights using a Glean Client API token.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  28. REPLACE USING flows for standalone streaming tables (Beta)

    Replaces rows matching specified key columns, requires SEQUENCE BY column.

    #Databricks SQL#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  29. Notion connector (Beta)

    Ingests Notion pages, databases, and users into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  30. Orchestrate continuous pipelines with continuous jobs

    Determines execution mode, allows serverless Standard performance mode. Replaces pipeline's built-in continuous setting.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  31. READ METADATA privilege is GA

    Provides read-only visibility into security-sensitive metadata, including privilege grants and ABAC policies.

    #Security#Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  32. Change data feed on materialized views (Beta)

    Requires Databricks Runtime 18 LTS or above. Enables replication to external destinations.

    #Databricks SQL#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  33. Tag automations (Beta)

    Assigns or removes governed tags on Unity Catalog tables or volumes based on defined conditions.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  34. REPLACE USING flows for pipelines (Beta)

    Replaces rows matching specified key columns, doesn't require change data capture feed or primary key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  35. Google Drive connector (GA)

    Supports fully managed and custom ingestion pipelines with Spark and SQL APIs.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  36. NetSuite connector (GA)

    Ingests ERP and financial data from Oracle NetSuite into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  37. PagerDuty connector (Beta)

    Ingests incident, on-call, service, and audit data from PagerDuty into Databricks.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  38. SharePoint connector (GA)

    Includes managed and standard connectors for ingestion pipelines.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  39. Automatic cost attribution for materialized views and streaming tables in Databricks SQL

    Inherits custom tags from enclosing SQL warehouse environment for billing.

    #Databricks SQL#Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  40. Refresh materialized views and streaming tables without exempting the pipeline owner from ABAC policies

    Pipeline owners are now subject to ABAC policies when refreshing views and tables. Policies are evaluated using the pipeline owner's identity.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  41. Secrets in Unity Catalog is GA

    Stores secrets as securable objects with Unity Catalog privileges. Uses catalog.schema.secret namespace.

    #Unity Catalog
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)
  42. OpenAI connector (Beta)

    Uses OpenAI Organization Admin API to ingest admin data, authenticates with OpenAI Admin API key.

    #Lakeflow
    AWS, read it on their docsAzure, read it on their docsGCP, read it on their docsSAP(unknown)

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.