# Announcing On-Demand State Repartitioning for Apache Spark™ Structured Streaming on Databricks

DevFeed: [Announcing On-Demand State Repartitioning for Apache Spark™ Structured Streaming on Databricks](<https://devfeed.tech/articles/announcing-on-demand-state-repartitioning-for-apache-sparktm-structured-streaming-on-databricks-26235.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/announcing-demand-state-repartitioning-apache-sparktm-structured-streaming-databricks>)

Author: Thangam Vaiyapuri; Jay Palaniappan; B. Micheal Okutubo; Zifei Feng

Published: 2026-09-14T21:04:30Z

Content type: release

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Streaming](<https://devfeed.tech/topics/streaming.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [real-time](<https://devfeed.tech/topics/real-time.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [API](<https://devfeed.tech/topics/api.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [api](<https://devfeed.tech/tags/api.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [fraud-detection](<https://devfeed.tech/tags/fraud-detection.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [net-11-preview-7](<https://devfeed.tech/tags/net-11-preview-7.md>), [production](<https://devfeed.tech/tags/production.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [streaming](<https://devfeed.tech/tags/streaming.md>)

## AI overview

Databricks announces on-demand state repartitioning for Apache Spark Structured Streaming in Public Preview, available in Databricks Runtime 18 and later. The capability lets production stateful streaming queries resize their partition count while preserving checkpoint state, supporting workloads such as aggregations, stream-stream joins, deduplication, sessionization, and transformWithState. Coveo reports reducing related Amazon S3 API costs by 40%.

## Source excerpt

Anyone running stateful Apache Spark™ Structured Streaming queries in production...