Skip to content

Databricks releases, every cloud

92 releases of 1321

Last updated

  1. Upcoming general availability of Unity Gateway Coming soon

    Extends Unity Catalog governance to runtime interactions, controls AI service usage, and monitors traffic. Available by default for workspaces with compliance security profile in mid-September.

  2. Unit testing for pipelines (Beta)

    Validates Python and SQL transformations against mock data. Requires Lakeflow Pipelines Editor.

  3. Governed tags system table is in Beta

    Contains records for each governed tag key, including customer-created and system-generated tags.

  4. C++ SDK for the Zerobus Ingest connector is now available in Beta

    Supports JSON and Protocol Buffers for ingesting into Unity Catalog Delta tables.

  5. Databricks-hosted sample datasets available in the samples catalog

    Available in Unity Catalog-enabled workspaces through OpenSharing as samples.databricks.datasets.

  6. Override the REPLACE WHERE predicate for a single refresh

    Adds a WHERE clause to the REFRESH STREAMING TABLE command. Applies to standalone streaming tables with FLOW REPLACE WHERE clause.

  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. Role-based access control (RBAC) is in Public Preview

    Lets users assume a role with limited permissions. Requires account and workspace admin setup.

  9. Reddit Ads connector is now available in Beta

    Ingests advertising campaign data and performance metrics from Reddit Ads into Databricks.

  10. Anthropic managed ingestion connector (Beta)

    Ingests Compliance API data, including audit activity and Claude chats, into Databricks.

  11. MLflow trace storage in Unity Catalog is now generally available

    Stores traces in OpenTelemetry format with unlimited storage and SQL query access.

  12. Query-based connectors in Lakeflow Connect will soon be available by default for workspaces with the compliance security profile enabled Coming soon

    Replaces CDC configuration, supports Oracle, Teradata, and others.

  13. Request for Access will soon be enabled by default for all workspaces Coming soon

    Routes requests to Unity Catalog object owners via email, replacing workspace-level settings.

  14. Secrets in Unity Catalog (Public Preview)

    Uses three-level namespace and Unity Catalog privileges for access control.

  15. Change to default pipeline editor for workspaces with the compliance security profile enabled Coming soon

    Replaces legacy editor, removing it in August.

  16. Strac connector (Beta)

    Ingests Strac data-security audit events using a Strac API key.

  17. Behavior changes for continuous jobs and pipelines Coming soon

    Configures continuous schedule from pipeline page, wrapping pipeline in a continuous job. Replaces pipeline's built-in continuous setting for new pipelines.

  18. Restrict access to AI Functions with Unity Catalog permissions (Public Preview)

    Requires account team enablement, restricts access to task-specific AI Functions.

  19. REPLACE WHERE flows are now generally available

    Replaces full table reprocessing with row-level updates based on a predicate.

  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Standard performance mode is now supported for materialized view or streaming table refreshes in jobs

    Consumes fewer DBUs when Performance optimized setting is off.

  22. Lakeflow Connect row filtering is now generally available

    Works like a SQL WHERE clause, applies to initial and incremental updates.

  23. Veeva Vault connector (Beta)

    Ingests standard and custom objects from Veeva using OAuth 2.0 M2M auth.

  24. Run a subset of job tasks with their dependencies

    Add + modifier to task key to include dependencies, usable via UI, API, or CLI.

  25. Govern LLMs in Unity Catalog with model services (Beta)

    Represents a governed LLM endpoint, sharable across workspaces via Unity Catalog privileges.

  26. SQL alert task in Lakeflow Jobs is now generally available

    Evaluates a Databricks SQL alert as part of a Lakeflow Job, returning its state for downstream tasks.

  27. Microsoft Dynamics 365 connector (GA)

    Ingests CRM and ERP data into Databricks using Azure Synapse Link.

  28. Change the owner of standalone pipeline streaming tables and materialized views

    Uses ALTER STREAMING TABLE and ALTER MATERIALIZED VIEW with SET OWNER TO. Applies to standalone pipeline datasets in Databricks SQL.

  29. Standalone pipeline materialized views support expectations

    Validates records in materialized views using CONSTRAINT clause. Replaces manual validation in standalone pipelines.

  30. Enable access requests across your Unity Catalog metastore (Public Preview)

    Enables requests at metastore level, inherited by all catalogs and schemas.

  31. Square managed ingestion connector (Beta)

    Ingests point-of-sale data like payments and orders from Square into Databricks.

  32. The Discover page is now in Public Preview

    Helps find Unity Catalog data assets without requiring catalog hierarchy knowledge. Organizes tables and dashboards by business area.

  33. Wiz Audit Logs managed ingestion connector (Beta)

    Ingests Wiz audit log entries, issues, and vulnerability findings into Databricks.

  34. Netskope Logs managed ingestion connector (Beta)

    Ingests Netskope event and alert logs into Databricks.

  35. Incremental ingestion for Workday Reports (Beta)

    Ingests only changed rows since last pipeline run if a cursor column is configured.

  36. Salesforce Marketing Cloud managed ingestion connector (Beta)

    Ingests campaigns, journeys, and email events from Salesforce Marketing Cloud into Databricks.

  37. Comments on foreign tables (Beta)

    Syncs table and column comments from external data sources to Unity Catalog foreign tables.

  38. OneLake catalog federation is generally available

    Allows reading OneLake data without copying, with read-only access and direct queries against file storage.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(not on this cloud)
  39. Configure the recovery period for dropped managed tables (Public Preview)

    Sets recovery period to 0 hours or 7-30 days, requires Databricks Runtime 17.3.

  40. Databricks-to-Databricks Delta Sharing across regulatory domains is now available (Public Preview)

    Supports sharing with AWS GovCloud, AWS GovCloud DoD, and Azure China.

  41. ABAC GRANT policies for models (Beta)

    Grants EXECUTE privilege on models based on governed tags, supporting MLflow and foundation models.

  42. Zip connector (Beta)

    Ingests data from Zip, a new option in Lakeflow Connect.

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.