Skip to content

Databricks releases, every cloud

216 releases of 1321

Last updated

  1. JAR tasks on serverless compute will soon be available for workspaces with the compliance security profile enabled Coming soon

    Replaces cluster provisioning, available in Lakeflow Jobs.

  2. Session restore for serverless jobs is in Public Preview

    Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.

  3. Standard performance mode is now available for one-time runs in the Jobs API

    Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.

  4. Maintenance windows for continuous pipelines

    Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.

  5. Managed tables in Lakeflow pipelines (Beta)

    Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.

  6. The Azure Databricks Excel Add-in is now generally available

    Connects Excel to Azure Databricks workspace for querying and data import. Enables Live query for pivot tables.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  7. Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
  8. The Databricks Excel Add-in is now generally available

    Connects Excel to Databricks workspace for querying and data import. Enables live query for pivot tables.

    AWS, read it on their docsAzure(not on this cloud)GCP, read it on their docsSAP(unknown)
  9. Anaplan connector (Beta)

    Ingests Anaplan audit trail events and user account records into Databricks.

  10. Anysphere Organization connector (Beta)

    Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.

  11. Celigo connector (Beta)

    Ingests Celigo audit log events into Databricks using an API token.

  12. Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon

    Replaces full snapshot default, improving performance and reducing cost.

  13. Zerobus Ingest into default storage is now in Public Preview

    Supports tables backed by default storage, requires Lakeflow Connect setup.

  14. Private network gateway is in Beta

    Connects serverless compute to VNet and on-premises systems through a managed gateway. Enabled from account console Previews page.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  15. Apache Arrow support for Zerobus Ingest is now generally available

    Replaces JSON and Avro formats, requires Lakeflow Connect.

  16. Pipeline events system table is in Beta

    Records Lakeflow pipeline event logs, capturing lifecycle transitions and errors, for querying and building alerts.

  17. Atlassian Audit Logs connector (Beta)

    Ingests Atlassian organization audit log events using an API key.

  18. Genie Code is now available as a Lakeflow Jobs task (Beta)

    Runs prompts autonomously, reading upstream outputs and calling tools as needed, returning a conversation link.

  19. Zerobus Ingest into streaming tables is now generally available

    Works like writing to a managed Delta table with same limits and quotas.

  20. Get this table by email. One Monday mail covering the week, filtered to the clouds and products you run. Weekly digest
  21. Anysphere Audit Logs connector (Beta)

    Uses Anysphere Admin API to ingest audit-log events, requires Cursor Admin API key.

  22. Connect to the Databricks Genie app in Microsoft Teams with your workspace URL (Public Preview)

    Replaces server hostname with workspace URL for connection.

  23. Private network gateway is in Private Preview

    Connects serverless compute to VPC and on-premises systems through a managed gateway, reusing existing network connectivity configuration.

    AWS, read it on their docsAzure, read it on their docsGCP(not on this cloud)SAP(unknown)
  24. Verkada connector (Beta)

    Ingests Verkada organization audit logs and access users using a Verkada API key.

  25. Inbound Private Service Connect for performance-intensive services (Beta)

    Enables private connectivity to services like Zerobus Ingest and Lakebase Autoscaling on Google Cloud.

    AWS(not on this cloud)Azure(not on this cloud)GCP, read it on their docsSAP(unknown)
  26. Default Python package repositories are GA for Lakeflow pipelines and classic compute

    Supports private or authenticated registries as workspace defaults. Applies to UI and API created classic compute.

  27. Performance mode now applies to materialized view and streaming table refreshes from dbt tasks

    Now applies to dbt tasks, with optional Standard mode for lower costs, increasing latency to 4-6 minutes.

  28. Salesforce connector mTLS authentication is now generally available

    Replaces OAuth client credentials flow for API-only users, requires client certificates.

  29. Workiva connector (Beta)

    Ingests Workiva audit activity, users, and roles using OAuth2 client credentials.

  30. Cross-workspace access for serverless (Beta)

    Controls serverless network traffic between workspaces with ingress and egress rules.

  31. Custom URL access to workspaces over inbound Private Link (Beta)

    Uses general_access private endpoint, serves workspaces and account-level resources across regions.

    AWS(not on this cloud)Azure, read it on their docsGCP(not on this cloud)SAP(unknown)
  32. Gmail connector in Lakeflow Connect (Beta)

    Ingests messages, labels, drafts, filters, and profile data using a Google service account.

  33. SendGrid connector (Beta)

    Ingests SendGrid subuser directory and IP access activity using a parent-account API key.

  34. SQL alert task in Lakeflow Jobs is now available by default for workspaces with the compliance security profile enabled

    Supports all Databricks compliance security profile standards, returns evaluation state as output.

  35. Amplitude connector (Beta)

    Ingests product analytics event data with metadata from Amplitude.

  36. Custom trace views in the MLflow trace explorer are in Beta

    Genie generates views based on plain language descriptions, surfacing relevant trace fields and metrics.

  37. Glean connector in Lakeflow Connect (Beta)

    Ingests company-wide usage insights using a Glean Client API token.

  38. REPLACE USING flows for standalone streaming tables (Beta)

    Replaces rows matching specified key columns, requires SEQUENCE BY column.

  39. Notion connector (Beta)

    Ingests Notion pages, databases, and users into Databricks.

  40. Orchestrate continuous pipelines with continuous jobs

    Determines execution mode, allows serverless Standard performance mode. Replaces pipeline's built-in continuous setting.

  41. Change data feed on materialized views (Beta)

    Requires Databricks Runtime 18 LTS or above. Enables replication to external destinations.

  42. JAR tasks on serverless compute are now generally available

    Requires matching Scala, Java Development Kit, and Databricks Connect versions.

Headlines, dates and product areas are Databricks' own, from the release notes published for each cloud, and every item links to the note it came from. The one-line summaries are ours. Not a Databricks product and not affiliated with Databricks, Inc.