# partition

Published articles for partition.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Architecting a secure landing zone in the AWS European Sovereign Cloud

DevFeed: [Architecting a secure landing zone in the AWS European Sovereign Cloud](<https://devfeed.tech/articles/architecting-a-secure-landing-zone-in-the-aws-european-sovereign-cloud-31478.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/security/architecting-a-secure-landing-zone-in-the-aws-european-sovereign-cloud/>)

Author: Pablo Pagani

Published: 2026-09-16T21:20:48Z

Content type: article

Language: en

Sources: [AWS Security Blog](<https://devfeed.tech/sources/aws-security-blog.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Architecture & Design](<https://devfeed.tech/topics/architecture-design.md>), [AWS IAM](<https://devfeed.tech/topics/aws-iam.md>), [Infrastructure as code](<https://devfeed.tech/topics/infrastructure-as-code.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [SIEM, Security](<https://devfeed.tech/topics/siem-security.md>), [Incident response](<https://devfeed.tech/topics/incident-response.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-identity-and-access-management-iam](<https://devfeed.tech/tags/aws-identity-and-access-management-iam.md>), [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [eu](<https://devfeed.tech/tags/eu.md>), [europe](<https://devfeed.tech/tags/europe.md>), [incident-response](<https://devfeed.tech/tags/incident-response.md>), [infrastructure-as-code-iac](<https://devfeed.tech/tags/infrastructure-as-code-iac.md>), [partition](<https://devfeed.tech/tags/partition.md>), [security](<https://devfeed.tech/tags/security.md>), [security-blog](<https://devfeed.tech/tags/security-blog.md>), [security-identity-compliance](<https://devfeed.tech/tags/security-identity-compliance.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

This article explains how to architect a secure, scalable landing zone in the AWS European Sovereign Cloud. It describes the aws-eusc partition boundary and covers governance, identity, logging, data protection, network design, CI/CD, artifact distribution, and incident response.

### Source excerpt

The AWS European Sovereign Cloud is a new, independent cloud for Europe, physically and logically separate from existing AWS Regions and operated within the European Union (EU). It provides the same services, features, and APIs as AWS commercial Regions, but runs as a distinct AWS partition (aws-eusc), with its own control plane, AWS Identity and [...]

## "Regex for Rows": Simplifying Pattern Detection in SQL with MATCH\_RECOGNIZE

DevFeed: ["Regex for Rows": Simplifying Pattern Detection in SQL with MATCH\_RECOGNIZE](<https://devfeed.tech/articles/regex-for-rows-simplifying-pattern-detection-in-sql-with-match-recognize-31401.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/regex-rows-simplifying-pattern-detection-sql-matchrecognize>)

Author: Kent Marten; Sergei Fedorov

Published: 2026-09-16T17:14:05Z

Content type: tutorial

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [SQL](<https://devfeed.tech/topics/sql.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [Cybersecurity](<https://devfeed.tech/topics/cybersecurity.md>), [Security & Privacy](<https://devfeed.tech/topics/security-privacy.md>)

Tags: [count](<https://devfeed.tech/tags/count.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [failed](<https://devfeed.tech/tags/failed.md>), [false-positives](<https://devfeed.tech/tags/false-positives.md>), [functions](<https://devfeed.tech/tags/functions.md>), [login](<https://devfeed.tech/tags/login.md>), [partition](<https://devfeed.tech/tags/partition.md>), [product](<https://devfeed.tech/tags/product.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [regex](<https://devfeed.tech/tags/regex.md>), [sql](<https://devfeed.tech/tags/sql.md>), [window-functions](<https://devfeed.tech/tags/window-functions.md>)

### AI overview

This tutorial explains how Databricks supports SQL MATCH_RECOGNIZE for detecting ordered event patterns. It shows how the clause can simplify sequence detection, including identifying repeated login failures followed by a successful login, compared with complex SQL queries and window functions.

### Source excerpt

Imagine you work in cybersecurity and you have a table that tracks login attempts...

## How We Built Automated Capacity Testing for Kafka Consumers

DevFeed: [How We Built Automated Capacity Testing for Kafka Consumers](<https://devfeed.tech/articles/how-we-built-automated-capacity-testing-for-kafka-consumers-23723.md>)

Original publisher: [Read original article](<https://medium.com/booking-com-development/how-we-built-automated-capacity-testing-for-kafka-consumers-1853623bce78?source=rss----1c36c35f9c76---4>)

Author: Kaan Karakaya

Published: 2026-09-14T09:46:34Z

Content type: tutorial

Language: en

Sources: [Booking.com Development - Medium](<https://devfeed.tech/sources/booking-com-development-medium.md>)

Topics: [Kafka](<https://devfeed.tech/topics/kafka.md>), [Testing](<https://devfeed.tech/topics/testing.md>), [HTTP](<https://devfeed.tech/topics/http.md>)

Tags: [automated](<https://devfeed.tech/tags/automated.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [health-checks](<https://devfeed.tech/tags/health-checks.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [load](<https://devfeed.tech/tags/load.md>), [load-balancer](<https://devfeed.tech/tags/load-balancer.md>), [parallelism](<https://devfeed.tech/tags/parallelism.md>), [partition](<https://devfeed.tech/tags/partition.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [scale](<https://devfeed.tech/tags/scale.md>), [site-reliability-engineer](<https://devfeed.tech/tags/site-reliability-engineer.md>), [sre](<https://devfeed.tech/tags/sre.md>), [testing](<https://devfeed.tech/tags/testing.md>)

### AI overview

This article describes Booking.com's extension of an existing capacity-testing platform for Kafka consumers. It explains how changing partition assignment can provide a controlled, measurable way to test consumer throughput and whether remaining consumers can absorb reassigned work after an instance or failure domain disappears.

### Source excerpt

Photo by GuerrillaBuzz on Unsplash Kafka makes it easy to distribute work across consumer instances. It is much harder to prove, safely and repeatedly, how those instances behave when the distribution changes and one of them has to carry more than its usual share. For teams that run Kafka at scale, this is a practical reliability question: how much load can a consumer instance actually handle? We had automated capacity testing for HTTP services, but Kafka consumers were still tested with manual drills. Those drills could tell us something, but they were disruptive, difficult to reproduce, and risky precisely when the system was close to its limit. We wanted a controlled way to answer three questions: What is the maximum sustainable throughput of a consumer instance? If an instance or failure domain disappears, can the remaining consumers absorb the reassigned work? Are we overprovisioning resources because we do not know the real limit? The result was an extension to our capacity-testing platform that turns Kafka partition assignment into a safe, measurable load-control mechanism. Why HTTP capacity testing did not translate Our existing platform was designed for request-response services behind a load balancer. A scheduled test selects one instance, routes an increasing share of traffic to it, runs health checks after each step, and records the highest ratio the instance can sustain. After the test, traffic returns to its normal distribution and the result is reported to the service owner. Kafka has no equivalent traffic knob. Consumers pull records, and the unit of parallelism is the partition. Within a consumer group, each partition is owned by one consumer at a time. If a topic has 12 partitions and four equally loaded instances, each instance owns about three. When one instance disappears, a rebalance gives the survivors more partitions -- and the extra work arrives as a step change, not as a smooth increase from a load balancer. The key translation: for an HTTP

## Linux swap Commands: Create and Manage Swap Files/Partitions

DevFeed: [Linux swap Commands: Create and Manage Swap Files/Partitions](<https://devfeed.tech/articles/linux-swap-commands-create-and-manage-swap-files-partitions-20882.md>)

Original publisher: [Read original article](<https://linuxblog.io/swap-command-create-manage-swap-files-partitions/>)

Author: Hayden James

Published: 2026-08-26T15:13:53Z

Content type: tutorial

Language: en

Sources: [Hayden James](<https://devfeed.tech/sources/hayden-james.md>)

Topics: [Linux](<https://devfeed.tech/topics/linux.md>), [btrfs](<https://devfeed.tech/topics/btrfs.md>), [Kernel](<https://devfeed.tech/topics/kernel.md>), [rhel](<https://devfeed.tech/topics/rhel.md>)

Tags: [blog](<https://devfeed.tech/tags/blog.md>), [btrfs](<https://devfeed.tech/tags/btrfs.md>), [commands](<https://devfeed.tech/tags/commands.md>), [desktop](<https://devfeed.tech/tags/desktop.md>), [files](<https://devfeed.tech/tags/files.md>), [fstab](<https://devfeed.tech/tags/fstab.md>), [gotchas](<https://devfeed.tech/tags/gotchas.md>), [guide](<https://devfeed.tech/tags/guide.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [linux](<https://devfeed.tech/tags/linux.md>), [partition](<https://devfeed.tech/tags/partition.md>), [performance](<https://devfeed.tech/tags/performance.md>), [server](<https://devfeed.tech/tags/server.md>), [sysadmins](<https://devfeed.tech/tags/sysadmins.md>)

### AI overview

A practical guide to creating, activating, deactivating, and troubleshooting Linux swap files and partitions using mkswap, swapon, and swapoff. It also explains filesystem-specific considerations, including Btrfs and older XFS kernels.

### Source excerpt

A practical guide to creating, managing, and tuning swap files and swap partitions on Linux using mkswap, swapon, and swapoff, with real commands and common troubleshooting fixes. Continue reading...

## Where Kafka Fits in Modern Systems

DevFeed: [Where Kafka Fits in Modern Systems](<https://devfeed.tech/articles/where-kafka-fits-in-modern-systems-18029.md>)

Original publisher: [Read original article](<https://blog.levelupcoding.com/p/kafka-use-cases>)

Author: Nikki Siapno

Published: 2026-08-25T12:02:09Z

Content type: tutorial

Language: en

Sources: [Level Up Coding System Design Newsletter](<https://devfeed.tech/sources/level-up-coding-system-design-newsletter.md>)

Topics: [Kafka](<https://devfeed.tech/topics/kafka.md>), [Event-Streaming](<https://devfeed.tech/topics/event-streaming.md>), [systems](<https://devfeed.tech/topics/systems.md>), [distributed-systems](<https://devfeed.tech/topics/distributed-systems.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [consumer](<https://devfeed.tech/tags/consumer.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [durability](<https://devfeed.tech/tags/durability.md>), [event-streaming](<https://devfeed.tech/tags/event-streaming.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [parallelism](<https://devfeed.tech/tags/parallelism.md>), [partition](<https://devfeed.tech/tags/partition.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [systems](<https://devfeed.tech/tags/systems.md>)

### AI overview

This article explains when Apache Kafka is appropriate for distributed systems. It presents Kafka as a durable event log whose replayability, consumer fan-out, and partition-based parallelism support real-time data pipelines and shared event-driven architectures, while warning that Kafka can add unnecessary operational complexity for simpler asynchronous workflows.

### Source excerpt

When should you actually use Kafka? And when is it just unnecessary complexity?

## How to Set Up Hibernation on Linux (Swap Done Right)

DevFeed: [How to Set Up Hibernation on Linux (Swap Done Right)](<https://devfeed.tech/articles/how-to-set-up-hibernation-on-linux-swap-done-right-20881.md>)

Original publisher: [Read original article](<https://linuxblog.io/set-up-hibernation-linux-swap/>)

Author: Hayden James

Published: 2026-08-24T15:11:25Z

Content type: tutorial

Language: en

Sources: [Hayden James](<https://devfeed.tech/sources/hayden-james.md>)

Topics: [Linux](<https://devfeed.tech/topics/linux.md>), [Kernel](<https://devfeed.tech/topics/kernel.md>), [Debian](<https://devfeed.tech/topics/debian.md>), [xfce](<https://devfeed.tech/topics/xfce.md>)

Tags: [archlinux](<https://devfeed.tech/tags/archlinux.md>), [blog](<https://devfeed.tech/tags/blog.md>), [debian](<https://devfeed.tech/tags/debian.md>), [desktop](<https://devfeed.tech/tags/desktop.md>), [distro](<https://devfeed.tech/tags/distro.md>), [hibernate](<https://devfeed.tech/tags/hibernate.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [kernel](<https://devfeed.tech/tags/kernel.md>), [linux](<https://devfeed.tech/tags/linux.md>), [memory](<https://devfeed.tech/tags/memory.md>), [partition](<https://devfeed.tech/tags/partition.md>), [rhel](<https://devfeed.tech/tags/rhel.md>), [xfce](<https://devfeed.tech/tags/xfce.md>)

### AI overview

A practical Linux hibernation guide explains how to use separate swap spaces for everyday paging and hibernation. It addresses a problem where a swap partition becomes too full to hold the compressed hibernation image.

### Source excerpt

I recently reinstalled my main desktop from scratch: Debian testing via Kali underneath (read first before judging) and XFCE on top. One of the reasons I keep coming back to XFCE is its built-in power management. Continue reading...

## How to Achieve Pruning When Querying by Non-Partitioned Columns in PostgreSQL

DevFeed: [How to Achieve Pruning When Querying by Non-Partitioned Columns in PostgreSQL](<https://devfeed.tech/articles/how-to-achieve-pruning-when-querying-by-non-partitioned-columns-in-postgresql-33924.md>)

Original publisher: [Read original article](<https://hakibenita.com/postgresql-partition-pruning>)

Author: Haki Benita

Published: 2026-07-08T21:00:00Z

Content type: tutorial

Language: en

Sources: [Haki Benita](<https://devfeed.tech/sources/haki-benita.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [Databases](<https://devfeed.tech/topics/databases.md>)

Tags: [articles](<https://devfeed.tech/tags/articles.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [index](<https://devfeed.tech/tags/index.md>), [partition](<https://devfeed.tech/tags/partition.md>), [patterns](<https://devfeed.tech/tags/patterns.md>), [performance](<https://devfeed.tech/tags/performance.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [query](<https://devfeed.tech/tags/query.md>)

### AI overview

This tutorial explains PostgreSQL partition pruning and shows how certain data patterns can enable pruning when queries filter on columns other than the partition key. It uses event data partitioned by year and examines queries by date range and session.

### Source excerpt

Under conventional wisdom, pruning can only be achieved when querying by the partition key. However, if your data follows certain patterns, using some clever tricks you can achieve pruning even when filtering by non-partition key columns.

## Lightweight deletes for Tinybird Data Sources now in Beta

DevFeed: [Lightweight deletes for Tinybird Data Sources now in Beta](<https://devfeed.tech/articles/lightweight-deletes-for-tinybird-data-sources-now-in-beta-18553.md>)

Original publisher: [Read original article](<https://www.tinybird.co/blog/lightweight-deletes>)

Author: Jesús Botella

Published: 2026-06-30T12:00:00Z

Content type: release

Language: en

Sources: [Tinybird](<https://devfeed.tech/sources/tinybird.md>)

Topics: [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [data](<https://devfeed.tech/tags/data.md>), [partition](<https://devfeed.tech/tags/partition.md>), [product-updates](<https://devfeed.tech/tags/product-updates.md>)

### AI overview

Tinybird has added a beta endpoint for ClickHouse lightweight DELETE operations. It supports synchronous deletion and asynchronous deletion with polling for partition progress.

### Source excerpt

A new endpoint exposes ClickHouse's lightweight DELETE functionality in Tinybird: pick between a synchronous call that blocks until the delete is done, or an asynchronous one that you poll for partition progress.

## How Partition Access Visualizations Reduced our Data Lake S3 Cost by 33%

DevFeed: [How Partition Access Visualizations Reduced our Data Lake S3 Cost by 33%](<https://devfeed.tech/articles/how-partition-access-visualizations-reduced-our-data-lake-s3-cost-by-33-27427.md>)

Original publisher: [Read original article](<https://engineeringblog.yelp.com/2026/05/partition-access-visualizations.html>)

Author: Nick Del Nano, Data Streaming

Published: 2026-05-21T00:00:00Z

Content type: article

Language: en

Sources: [Yelp](<https://devfeed.tech/sources/yelp.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [AWS IAM](<https://devfeed.tech/topics/aws-iam.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [aws](<https://devfeed.tech/tags/aws.md>), [data](<https://devfeed.tech/tags/data.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [iam](<https://devfeed.tech/tags/iam.md>), [partition](<https://devfeed.tech/tags/partition.md>), [s3](<https://devfeed.tech/tags/s3.md>)

### AI overview

Yelp describes visualizations that map partition keys against access-event timestamps to reveal daily batch jobs, backfills, and ad hoc queries. The resulting usage attribution supported Apache Iceberg migration and storage-efficiency work that reduced the cost of its petabyte-scale data lake by 33%.

### Source excerpt

Introduction In large analytics environments, data teams often struggle to answer deceptively simple questions, like who their stakeholders are and how their data is being used. At Yelp, we address this by visualizing access patterns, plotting time-based partition key values against access event timestamps. These visualizations reveal distinct usage signatures - ad hoc queries, daily batch jobs, and periodic backfills - allowing data owners to understand their stakeholders and use cases. This deeper insight into data usage has enabled high-impact platform initiatives including migrating thousands of tables to Apache Iceberg format and identifying storage efficiencies which reduced the cost of...

## How Split Brain Happens in Distributed Databases and How It Gets Fixed

DevFeed: [How Split Brain Happens in Distributed Databases and How It Gets Fixed](<https://devfeed.tech/articles/how-split-brain-happens-in-distributed-databases-and-how-it-gets-fixed-39654.md>)

Original publisher: [Read original article](<https://www.gauravsarma.com/posts/2026-03-31_split-brain-in-distributed-databases>)

Published: 2026-03-31T00:00:00Z

Content type: tutorial

Language: en

Sources: [Gaurav Sarma's Blog](<https://devfeed.tech/sources/gaurav-sarma-s-blog.md>)

Topics: [Databases](<https://devfeed.tech/topics/databases.md>), [Network](<https://devfeed.tech/topics/network.md>), [Replication](<https://devfeed.tech/topics/replication.md>), [CAP theorem](<https://devfeed.tech/topics/cap-theorem.md>)

Tags: [consensus](<https://devfeed.tech/tags/consensus.md>), [databases](<https://devfeed.tech/tags/databases.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [failed](<https://devfeed.tech/tags/failed.md>), [false-positives](<https://devfeed.tech/tags/false-positives.md>), [partition](<https://devfeed.tech/tags/partition.md>), [replication](<https://devfeed.tech/tags/replication.md>), [split-brain](<https://devfeed.tech/tags/split-brain.md>)

### AI overview

This tutorial explains how split brain occurs in distributed databases when a network partition causes multiple nodes to become primary and accept conflicting writes. It discusses why timeout-based failure detection can create false positives and introduces the distributed consensus complexity motivated by this failure mode.

### Source excerpt

. [How Split Brain Happens in Distributed Databases and How It Gets Fixed](split-brain-in-distributed-databases-cover...

## Databricks is abstracting away physical data engineering controls

DevFeed: [Databricks is abstracting away physical data engineering controls](<https://devfeed.tech/articles/databricks-is-no-longer-about-tuning-knobs-27242.md>)

Original publisher: [Read original article](<https://blog.dataexpert.io/p/databricks-is-for-data-analysts-not>)

Author: Zach Wilson

Published: 2026-02-24T01:03:11Z

Content type: opinion

Language: en

Sources: [DataExpert.io Newsletter](<https://devfeed.tech/sources/dataexpert-io-newsletter.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [partition](<https://devfeed.tech/tags/partition.md>), [partitioning](<https://devfeed.tech/tags/partitioning.md>), [sorting](<https://devfeed.tech/tags/sorting.md>), [spark](<https://devfeed.tech/tags/spark.md>)

### AI overview

This opinion article argues that Databricks is shifting away from hands-on data engineering by abstracting physical data modeling through features such as liquid clustering and predictive optimization. It also criticizes Databricks' support for managed Apache Iceberg tables after acquiring Tabular.

### Source excerpt

Databricks abstracts away almost all of the data engineering skills. Liquid clustering is the first place where things will get messy!

## Waiting for PostgreSQL 19 - Implement ALTER TABLE ... MERGE/SPLIT PARTITIONS ... command

DevFeed: [Waiting for PostgreSQL 19 - Implement ALTER TABLE ... MERGE/SPLIT PARTITIONS ... command](<https://devfeed.tech/articles/waiting-for-postgresql-19-implement-alter-table-merge-split-partitions-command-33671.md>)

Original publisher: [Read original article](<https://www.depesz.com/2026/01/04/waiting-for-postgresql-19-implement-alter-table-merge-split-partitions-command/>)

Author: depesz

Published: 2026-01-04T17:30:47Z

Content type: opinion

Language: en

Sources: [select \* from depesz;](<https://devfeed.tech/sources/select-from-depesz.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [function](<https://devfeed.tech/topics/function.md>)

Tags: [command](<https://devfeed.tech/tags/command.md>), [locking](<https://devfeed.tech/tags/locking.md>), [merge](<https://devfeed.tech/tags/merge.md>), [partition](<https://devfeed.tech/tags/partition.md>), [partitioning](<https://devfeed.tech/tags/partitioning.md>), [partitions](<https://devfeed.tech/tags/partitions.md>), [pg19](<https://devfeed.tech/tags/pg19.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [split](<https://devfeed.tech/tags/split.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>), [waiting](<https://devfeed.tech/tags/waiting.md>)

### AI overview

A PostgreSQL 19 development update describes the ALTER TABLE command for merging and splitting partitions. The patch was rolled back after earlier discussion, then recommitted; testing showed it worked as expected, with slightly less locking observed. Further changes may be needed before the feature reaches the final release.

### Source excerpt

Important update This has been rolled back after some discussion. On 14th of December 2025, Alexander Korotkov committed patch: Implement ALTER TABLE ... MERGE PARTITIONS ... command This new DDL command merges several partitions into a single partition of the target table. The target partition is created using the new createPartitionTable() function with the ... Continue reading "Waiting for PostgreSQL 19 - Implement ALTER TABLE ... MERGE/SPLIT PARTITIONS ... command"

## How to Fix Kafka to ClickHouse® Performance Bottlenecks

DevFeed: [How to Fix Kafka to ClickHouse® Performance Bottlenecks](<https://devfeed.tech/articles/how-to-fix-kafka-to-clickhouse-performance-bottlenecks-18516.md>)

Original publisher: [Read original article](<https://www.tinybird.co/blog/how-to-fix-kafka-to-clickhouse-performance-bottlenecks>)

Author: Alberto Romeu

Published: 2025-12-30T00:00:00Z

Content type: tutorial

Language: en

Sources: [Tinybird](<https://devfeed.tech/sources/tinybird.md>)

Topics: [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [Kafka](<https://devfeed.tech/topics/kafka.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>), [Structured-data](<https://devfeed.tech/topics/structured-data.md>)

Tags: [best-practices](<https://devfeed.tech/tags/best-practices.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [distribution](<https://devfeed.tech/tags/distribution.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [partition](<https://devfeed.tech/tags/partition.md>), [performance](<https://devfeed.tech/tags/performance.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [scalable-analytics-architecture](<https://devfeed.tech/tags/scalable-analytics-architecture.md>), [schema](<https://devfeed.tech/tags/schema.md>), [view](<https://devfeed.tech/tags/view.md>)

### AI overview

A tutorial on optimizing performance in Kafka-to-ClickHouse pipelines through schema optimization, Materialized View tuning, partition distribution strategies, and throughput practices.

### Source excerpt

Learn how to optimize your Kafka to ClickHouse pipeline performance with schema optimization, Materialized View tuning, partition distribution strategies and throughput best practices.

## Waiting for PostgreSQL 19 - Support COPY TO for partitioned tables.

DevFeed: [Waiting for PostgreSQL 19 - Support COPY TO for partitioned tables.](<https://devfeed.tech/articles/waiting-for-postgresql-19-support-copy-to-for-partitioned-tables-33666.md>)

Original publisher: [Read original article](<https://www.depesz.com/2025/10/22/waiting-for-postgresql-19-support-copy-to-for-partitioned-tables/>)

Author: depesz

Published: 2025-10-22T10:05:08Z

Content type: article

Language: en

Sources: [select \* from depesz;](<https://devfeed.tech/sources/select-from-depesz.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [command](<https://devfeed.tech/tags/command.md>), [copy](<https://devfeed.tech/tags/copy.md>), [partition](<https://devfeed.tech/tags/partition.md>), [partitioning](<https://devfeed.tech/tags/partitioning.md>), [partitions](<https://devfeed.tech/tags/partitions.md>), [performance](<https://devfeed.tech/tags/performance.md>), [pg19](<https://devfeed.tech/tags/pg19.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>), [waiting](<https://devfeed.tech/tags/waiting.md>)

### AI overview

The article discusses a PostgreSQL patch committed by Masahiko Sawada that adds direct COPY TO support for partitioned tables. Previously, users had to use COPY (SELECT ...) TO as a workaround. The author's test found similar performance, with COPY from a table slightly slower in the reported case.

### Source excerpt

On 20th of October 2025, Masahiko Sawada committed patch: Support COPY TO for partitioned tables. Previously, COPY TO command didn't support directly specifying partitioned tables so users had to use COPY (SELECT ...) TO variant. This commit adds direct COPY TO support for partitioned tables, improving both usability and performance. Performance tests show ... Continue reading "Waiting for PostgreSQL 19 - Support COPY TO for partitioned tables."

## Designing a Cloud-Native Event Log Beyond Kafka's Partition Model

DevFeed: [Designing a Cloud-Native Event Log Beyond Kafka's Partition Model](<https://devfeed.tech/articles/what-if-we-could-rebuild-kafka-from-scratch-18888.md>)

Original publisher: [Read original article](<https://www.morling.dev/blog/what-if-we-could-rebuild-kafka-from-scratch/>)

Published: 2025-04-24T14:25:00Z

Content type: opinion

Language: en

Sources: [Gunnar Morling](<https://devfeed.tech/sources/gunnar-morling.md>)

Topics: [Kafka](<https://devfeed.tech/topics/kafka.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [event driven](<https://devfeed.tech/topics/event-driven.md>), [systems](<https://devfeed.tech/topics/systems.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [event-sourcing](<https://devfeed.tech/tags/event-sourcing.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [partition](<https://devfeed.tech/tags/partition.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [s3](<https://devfeed.tech/tags/s3.md>)

### AI overview

The article proposes a personal wishlist for a durable cloud-native event log designed beyond Kafka's traditional architecture. It discusses separating storage and compute, using object storage such as S3, removing partitions, and providing key-centric streams with ordering and dynamically scalable consumers.

### Source excerpt

The last few days I spent some time digging into the recently announced KIP-1150 ("Diskless Kafka"), as well AutoMQ's Kafka fork, tightly integrating Apache Kafka and object storage, such as S3. Following the example set by WarpStream, these projects aim to substantially improve the experience of using Kafka in cloud environments, providing better elasticity, drastically reducing cost, and paving the way towards native lakehouse integration. This got me thinking, if we were to start all over and develop a durable cloud-native event log from scratch--Kafka.next if you will--which traits and characteristics would be desirable for this to have? Separating storage and compute and object store support would be table stakes, but what else should be there? Having used Kafka for many years for building event-driven applications as well as for running realtime ETL and change data capture pipelines, here's my personal wishlist:

## Introducing the Tinybird DynamoDB Connector in public beta

DevFeed: [Introducing the Tinybird DynamoDB Connector in public beta](<https://devfeed.tech/articles/introducing-the-tinybird-dynamodb-connector-in-public-beta-18481.md>)

Original publisher: [Read original article](<https://www.tinybird.co/blog/dynamodb-public-beta>)

Author: Cameron Archer

Published: 2024-09-20T00:00:00Z

Content type: release

Language: en

Sources: [Tinybird](<https://devfeed.tech/sources/tinybird.md>)

Topics: [DynamoDB](<https://devfeed.tech/topics/dynamodb.md>)

Tags: [dynamodb](<https://devfeed.tech/tags/dynamodb.md>), [partition](<https://devfeed.tech/tags/partition.md>), [product-updates](<https://devfeed.tech/tags/product-updates.md>)

### AI overview

Tinybird's DynamoDB Connector has entered public beta, enabling cross-partition queries in milliseconds.

### Source excerpt

The DynamoDB Connector just hit public beta. Cross-partition queries in milliseconds are now possible. Test it yourself.

## How to switch between multiple ESP32 firmware binaries stored in the flash memory

DevFeed: [How to switch between multiple ESP32 firmware binaries stored in the flash memory](<https://devfeed.tech/articles/how-to-switch-between-multiple-esp32-firmware-binaries-stored-in-the-flash-memory-13963.md>)

Original publisher: [Read original article](<https://developer.espressif.com/blog/switch-between-firmware-binaries/>)

Author: John Lee

Published: 2024-07-24T00:00:00Z

Content type: tutorial

Language: en

Sources: [Blog on Developer Portal](<https://devfeed.tech/sources/blog-on-developer-portal.md>)

Topics: [ESP32](<https://devfeed.tech/topics/esp32.md>), [Microcontroller](<https://devfeed.tech/topics/microcontroller.md>), [Embedded Software Dev](<https://devfeed.tech/topics/embedded-software-dev.md>), [Internet of things](<https://devfeed.tech/topics/iot.md>), [ESP32-S3](<https://devfeed.tech/topics/esp32-s3.md>), [m5stack](<https://devfeed.tech/topics/m5stack.md>), [Wokwi](<https://devfeed.tech/topics/wokwi.md>)

Tags: [binaries](<https://devfeed.tech/tags/binaries.md>), [blog](<https://devfeed.tech/tags/blog.md>), [boot](<https://devfeed.tech/tags/boot.md>), [bootloader](<https://devfeed.tech/tags/bootloader.md>), [bsp](<https://devfeed.tech/tags/bsp.md>), [build](<https://devfeed.tech/tags/build.md>), [code](<https://devfeed.tech/tags/code.md>), [embedded](<https://devfeed.tech/tags/embedded.md>), [embedded-systems](<https://devfeed.tech/tags/embedded-systems.md>), [esp32](<https://devfeed.tech/tags/esp32.md>), [esp32-p4](<https://devfeed.tech/tags/esp32-p4.md>), [esp32-s3](<https://devfeed.tech/tags/esp32-s3.md>), [espressif](<https://devfeed.tech/tags/espressif.md>), [firmware](<https://devfeed.tech/tags/firmware.md>), [flash](<https://devfeed.tech/tags/flash.md>), [gui](<https://devfeed.tech/tags/gui.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [iot](<https://devfeed.tech/tags/iot.md>), [m5stack](<https://devfeed.tech/tags/m5stack.md>), [memory](<https://devfeed.tech/tags/memory.md>), [ota](<https://devfeed.tech/tags/ota.md>), [partition](<https://devfeed.tech/tags/partition.md>), [quick-start](<https://devfeed.tech/tags/quick-start.md>), [releases](<https://devfeed.tech/tags/releases.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [wokwi](<https://devfeed.tech/tags/wokwi.md>)

### AI overview

A tutorial on using the ESP32 Graphical Bootloader to store multiple firmware images in flash memory and switch between them. It explains the bootloader flow, partition-table configuration, and steps for building, merging, flashing, and simulating the application.

### Source excerpt

Introduction# The ESP32 microcontroller is a versatile and powerful device, widely used in IoT and embedded applications. One of its advanced features is the ability to store multiple firmware images in its flash memory and switch between them. This capability can be leveraged for various purposes, such as testing different firmware versions, running multiple applications, or maintaining a backup firmware.

## 1st-stage GUI setup, Part 3 - December 2023: First tests

DevFeed: [1st-stage GUI setup, Part 3 - December 2023: First tests](<https://devfeed.tech/articles/1st-stage-gui-setup-part-3-december-2023-first-tests-32843.md>)

Original publisher: [Read original article](<https://reactos.org/blogs/gui-setup-part3-first-testing-problems/>)

Published: 2024-02-01T00:00:00Z

Content type: article

Language: en

Sources: [Front Page on ReactOS Website](<https://devfeed.tech/sources/front-page-on-reactos-website.md>)

Topics: [ReactOS](<https://devfeed.tech/topics/reactos.md>), [GUI](<https://devfeed.tech/topics/gui.md>), [Testing](<https://devfeed.tech/topics/testing.md>), [Code](<https://devfeed.tech/topics/code.md>)

Tags: [bootloader](<https://devfeed.tech/tags/bootloader.md>), [code](<https://devfeed.tech/tags/code.md>), [free](<https://devfeed.tech/tags/free.md>), [gui](<https://devfeed.tech/tags/gui.md>), [iso](<https://devfeed.tech/tags/iso.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [os](<https://devfeed.tech/tags/os.md>), [partition](<https://devfeed.tech/tags/partition.md>), [react](<https://devfeed.tech/tags/react.md>), [reactos](<https://devfeed.tech/tags/reactos.md>), [tests](<https://devfeed.tech/tags/tests.md>), [win32](<https://devfeed.tech/tags/win32.md>), [winapi](<https://devfeed.tech/tags/winapi.md>)

### AI overview

This third post in the ReactOS "1st-stage GUI setup" series describes December 2023 work testing the complete graphical installer with a partially Wine-synced setupapi DLL. It covers partition-management UI behavior, the all-in-one CD ISO test scenario, installation dialogs, hardware presets, and current limitations to initialized MBR disks, with GPT and uninitialized-disk support planned.

### Source excerpt

Greetings! Welcome to the third blog of the series "1st-stage GUI setup": September 2023: Partly Wine-syncing setupapi October-November 2023: Making partitioning UI work December 2023: First tests In this third blog post, I will cover my work done during the month of December 2023: testing the whole 1st-stage GUI setup, together with the partially wine-synced setupapi dll. Finishing and testing the partitioning page UI The first week was devoted to finally putting together the code for manipulating partitions from the user interface, using the new workflow, and testing it.

## Understanding How DynamoDB Scales

DevFeed: [Understanding How DynamoDB Scales](<https://devfeed.tech/articles/understanding-how-dynamodb-scales-18021.md>)

Original publisher: [Read original article](<https://blog.guilleojeda.com/understanding-how-dynamodb-scales>)

Author: Guillermo Ojeda

Published: 2023-10-19T14:40:53Z

Content type: tutorial

Language: en

Sources: [Guille Ojeda](<https://devfeed.tech/sources/guille-ojeda.md>)

Topics: [NoSQL](<https://devfeed.tech/topics/nosql.md>), [Database](<https://devfeed.tech/topics/database.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [Availability](<https://devfeed.tech/topics/availability.md>), [Resilience](<https://devfeed.tech/topics/resilience.md>), [Transactions](<https://devfeed.tech/topics/transactions.md>), [Provisioning](<https://devfeed.tech/topics/provisioning.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [availability](<https://devfeed.tech/tags/availability.md>), [aws](<https://devfeed.tech/tags/aws.md>), [databases](<https://devfeed.tech/tags/databases.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [dynamodb](<https://devfeed.tech/tags/dynamodb.md>), [nosql](<https://devfeed.tech/tags/nosql.md>), [partition](<https://devfeed.tech/tags/partition.md>), [provisioning](<https://devfeed.tech/tags/provisioning.md>), [resilience](<https://devfeed.tech/tags/resilience.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [transactions](<https://devfeed.tech/tags/transactions.md>)

### AI overview

This tutorial explains how DynamoDB scales horizontally through partitioning and replication across nodes. It compares provisioned capacity for reads and writes and explains read and write capacity units, consistency, data size limits, and the doubled capacity use of transactions.

### Source excerpt

Note: This content was originally published at the Simple AWS newsletter. As you probably know, DynamoDB is a NoSQL database. It's a managed, serverless service, meaning you just create a Table (that's the equivalent of a Database in Postgres), and A...

## Hermès Bélusca-Maïto hired full-time to work on the ReactOS GUI Setup

DevFeed: [Hermès Bélusca-Maïto hired full-time to work on the ReactOS GUI Setup](<https://devfeed.tech/articles/hermes-belusca-maito-hired-full-time-to-work-on-the-reactos-gui-setup-33122.md>)

Original publisher: [Read original article](<https://reactos.org/project-news/hermes-belusca-hired-full-time/>)

Published: 2023-10-01T00:00:00Z

Content type: news

Language: en

Sources: [Front Page on ReactOS Website](<https://devfeed.tech/sources/front-page-on-reactos-website.md>)

Topics: [ReactOS](<https://devfeed.tech/topics/reactos.md>), [GUI](<https://devfeed.tech/topics/gui.md>)

Tags: [bare-metal](<https://devfeed.tech/tags/bare-metal.md>), [bootloader](<https://devfeed.tech/tags/bootloader.md>), [community](<https://devfeed.tech/tags/community.md>), [free](<https://devfeed.tech/tags/free.md>), [gui](<https://devfeed.tech/tags/gui.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [os](<https://devfeed.tech/tags/os.md>), [partition](<https://devfeed.tech/tags/partition.md>), [react](<https://devfeed.tech/tags/react.md>), [reactos](<https://devfeed.tech/tags/reactos.md>), [registry](<https://devfeed.tech/tags/registry.md>), [team](<https://devfeed.tech/tags/team.md>), [virtual-machines](<https://devfeed.tech/tags/virtual-machines.md>), [win32](<https://devfeed.tech/tags/win32.md>), [winapi](<https://devfeed.tech/tags/winapi.md>)

### AI overview

ReactOS Deutschland e.V. hired Hermès Bélusca-Maïto to work full-time for five months on the ReactOS GUI Setup. The planned work includes completing setup functionality, adding GPT support, integrating registry callbacks, and making other refinements.

### Source excerpt

Our team proudly announces that ReactOS Deutschland e.V. has hired Hermès Bélusca-Maïto to work full-time on the ReactOS GUI Setup for the next 5 months, starting September 2, 2023. Hermès is a long-time contributor and developer who worked on the project since 2012. He has several skills and expertise into various components of ReactOS, notably being the Client/Server Runtime Subsystem (CSRSS), Console Server Subsystem (CONSRV), NTVDM, and others. His upcoming goal is to finish the first-stage ReactOS GUI setup, which offers an alternative to the classic first-stage text-mode setup (also called USETUP).

## Vertical vs. horizontal scaling: What's the difference and which is better?

DevFeed: [Vertical vs. horizontal scaling: What's the difference and which is better?](<https://devfeed.tech/articles/vertical-vs-horizontal-scaling-what-s-the-difference-and-which-is-better-23823.md>)

Original publisher: [Read original article](<https://cockroachlabs.com/blog/vertical-scaling-vs-horizontal-scaling>)

Author: Charlie Custer

Published: 2023-04-10T00:00:00Z

Content type: article

Language: en

Sources: [Cockroach Labs](<https://devfeed.tech/sources/cockroach-labs.md>)

Topics: [autoscaling](<https://devfeed.tech/topics/autoscaling.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Database](<https://devfeed.tech/topics/database.md>), [Server](<https://devfeed.tech/topics/server.md>)

Tags: [cloud](<https://devfeed.tech/tags/cloud.md>), [database](<https://devfeed.tech/tags/database.md>), [gcp](<https://devfeed.tech/tags/gcp.md>), [partition](<https://devfeed.tech/tags/partition.md>), [scale](<https://devfeed.tech/tags/scale.md>), [server](<https://devfeed.tech/tags/server.md>), [work](<https://devfeed.tech/tags/work.md>)

### AI overview

The article compares vertical scaling, which increases the capacity of existing machines, with horizontal scaling, which adds machines or nodes. It explains examples using cloud databases and notes that the better approach depends on the system and workload; scaling terminology can also be used imprecisely.

### Source excerpt

So you need to scale. That's a good problem to have! But should you scale up or scale out? There's no easy answer, so let's take a closer look at horizontal scaling vs. vertical scaling , how they compare, and what the pros and cons are for each approach.

## OTA Firmware Updates with ESP Privilege Separation

DevFeed: [OTA Firmware Updates with ESP Privilege Separation](<https://devfeed.tech/articles/ota-firmware-updates-with-esp-privilege-separation-13940.md>)

Original publisher: [Read original article](<https://developer.espressif.com/blog/ota-firmware-updates-with-esp-privilege-separation/>)

Author: John Lee

Published: 2023-01-29T00:00:00Z

Content type: tutorial

Language: en

Sources: [Blog on Developer Portal](<https://devfeed.tech/sources/blog-on-developer-portal.md>)

Topics: [ESP-IDF](<https://devfeed.tech/topics/esp-idf.md>), [Embedded Software Dev](<https://devfeed.tech/topics/embedded-software-dev.md>)

Tags: [blog](<https://devfeed.tech/tags/blog.md>), [business-logic](<https://devfeed.tech/tags/business-logic.md>), [esp](<https://devfeed.tech/tags/esp.md>), [esp-idf](<https://devfeed.tech/tags/esp-idf.md>), [esp-privilege-separation](<https://devfeed.tech/tags/esp-privilege-separation.md>), [esp32](<https://devfeed.tech/tags/esp32.md>), [firmware](<https://devfeed.tech/tags/firmware.md>), [firmware-update](<https://devfeed.tech/tags/firmware-update.md>), [iot](<https://devfeed.tech/tags/iot.md>), [ota](<https://devfeed.tech/tags/ota.md>), [partition](<https://devfeed.tech/tags/partition.md>), [security](<https://devfeed.tech/tags/security.md>), [updates](<https://devfeed.tech/tags/updates.md>)

### AI overview

This article explains independent over-the-air firmware updates for protected_app and user_app in ESP Privilege Separation. It describes the ESP-IDF partition layout, the user-app update workflow, background downloading, reboot handling, and optional signature verification.

### Source excerpt

Over-The-Air (OTA) firmware update is one of the most important feature of any connected device. It enables the developers to ship out new features and bug fixes by remotely updating the application. In ESP Privilege Separation, there are two applications -- protected_app and user_app for which the framework provides the ability to independently update both the application binaries. In this post we will describe the independent OTA update feature under ESP Privilege Separation.

## Migrating Kafka topics without downtime

DevFeed: [Migrating Kafka topics without downtime](<https://devfeed.tech/articles/migrating-kafka-topics-without-downtime-39620.md>)

Original publisher: [Read original article](<https://www.gauravsarma.com/posts/2022-09-15_Migrating-Kafka-topics-without-downtime-f863819cfb3d>)

Published: 2022-09-15T00:00:00Z

Content type: tutorial

Language: en

Sources: [Gaurav Sarma's Blog](<https://devfeed.tech/sources/gaurav-sarma-s-blog.md>)

Topics: [Kafka](<https://devfeed.tech/topics/kafka.md>), [ordering](<https://devfeed.tech/topics/ordering.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [version](<https://devfeed.tech/topics/version.md>)

Tags: [downtime](<https://devfeed.tech/tags/downtime.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [ordering](<https://devfeed.tech/tags/ordering.md>), [partition](<https://devfeed.tech/tags/partition.md>), [versioning](<https://devfeed.tech/tags/versioning.md>)

### AI overview

A tutorial for migrating Kafka topics by creating versioned replacement topics, redirecting publishers and consumers, and draining the old topics. It explains how partition counts affect ordering, concurrency, scalability, and management overhead, and notes that the author did not find a direct tool for migration without downtime.

### Source excerpt

Each kafka topic defines the number of partitions and replication factors when it's created. However, once a topic is created, the partition count cannot be changed without affecting the ordering guarantees of the kafka partitions since kafka uses the following formula to calculate which partition a record should go to: partition\_id = partition\_key % number of partitions Kafka partitions are the gateway to concurrency and scalability...

## How to use custom partition tables on ESP32

DevFeed: [How to use custom partition tables on ESP32](<https://devfeed.tech/articles/how-to-use-custom-partition-tables-on-esp32-13884.md>)

Original publisher: [Read original article](<https://developer.espressif.com/blog/how-to-use-custom-partition-tables-on-esp32/>)

Author: John Lee

Published: 2021-02-12T00:00:00Z

Content type: tutorial

Language: en

Sources: [Blog on Developer Portal](<https://devfeed.tech/sources/blog-on-developer-portal.md>)

Topics: [ESP32](<https://devfeed.tech/topics/esp32.md>), [Embedded Software Dev](<https://devfeed.tech/topics/embedded-software-dev.md>), [configuration](<https://devfeed.tech/topics/configuration.md>)

Tags: [blog](<https://devfeed.tech/tags/blog.md>), [bluetooth](<https://devfeed.tech/tags/bluetooth.md>), [bootloader](<https://devfeed.tech/tags/bootloader.md>), [esp-idf](<https://devfeed.tech/tags/esp-idf.md>), [esp32](<https://devfeed.tech/tags/esp32.md>), [espressif](<https://devfeed.tech/tags/espressif.md>), [firmware](<https://devfeed.tech/tags/firmware.md>), [flash](<https://devfeed.tech/tags/flash.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [iot](<https://devfeed.tech/tags/iot.md>), [ota](<https://devfeed.tech/tags/ota.md>), [partition](<https://devfeed.tech/tags/partition.md>), [storage](<https://devfeed.tech/tags/storage.md>), [wifi](<https://devfeed.tech/tags/wifi.md>)

### AI overview

This tutorial explains how ESP32 flash memory is organized and how custom partition tables can separate application firmware from persistent data. It references ESP-IDF v4.2 and discusses partitions used for configuration, calibration, WiFi and Bluetooth data, and OTA updates.

### Source excerpt

Introduction# When we create a new project using ESP32 , sometimes we need to store data in the flash to persist even after a restart or power down. In the past, the most common way to do that was by using EEPROM, with just a few bytes of storage ability which limited it for larger amount of data. On the other hand, the ESP32 uses a flash memory to store the firmware, including the bootloader and other relevant data.

[Next page](<https://devfeed.tech/tags/partition.md?cursor=WyIyMDIxLTAyLTEyVDAwOjAwOjAwKzAwOjAwIiwgImRiZDIwM2ZmLWY5YjktNGEyNS1hZDQ4LTEyMWNlMjkxZDgxYSJd>)