Databricks releases, every cloud
- Session restore for serverless jobs is in Public Preview
Restores Python variables and Spark session into a new notebook for debugging or exploration, requires eligible serverless compute job runs.
- Standard performance mode is now available for one-time runs in the Jobs API
Sets performance_target to STANDARD. Supports Apache Airflow's DatabricksSubmitRunOperator.
- Maintenance windows for continuous pipelines
Sets daily 1-hour window for platform updates. Configured via Jobs UI, Pipelines UI, or Jobs REST API.
- Managed tables in Lakeflow pipelines (Beta)
Creates tables that Lakeflow manages, replacing manual table creation, and supports migrating existing Structured Streaming workloads.
- Anaplan connector (Beta)
Ingests Anaplan audit trail events and user account records into Databricks.
- Anysphere Organization connector (Beta)
Ingests organization members and groups into Databricks via Anysphere Admin API. Requires API key authentication.
- Run the change, do not just read it. Hands-on labs in your own Databricks workspace, graded when you submit. Browse labs
- Celigo connector (Beta)
Ingests Celigo audit log events into Databricks using an API token.
- Incremental ingestion for Salesforce formula fields in Lakeflow Connect will soon be generally available Coming soon
Replaces full snapshot default, improving performance and reducing cost.
- See which chunks support each ai_search answer (Beta)
Added generate_citations option to show supporting chunks.
- time_bucket SQL function aligns timestamps to fixed-width time buckets
Replaces date_trunc for non-calendar units, requires origin and width parameters.
- Zerobus Ingest into default storage is now in Public Preview
Supports tables backed by default storage, requires Lakeflow Connect setup.
Headlines, dates and product areas are Databricks' own, and every item links to the note it came from. The one-line summaries are ours.