# Palantir's Elasticsearch reindexing system supports online index rebuilds

DevFeed: [Palantir's Elasticsearch reindexing system supports online index rebuilds](<https://devfeed.tech/articles/palantir-built-an-elasticsearch-indexing-machine-18130.md>)

Original publisher: [Read original article](<https://hungrymindsdev.substack.com/p/palantir-built-an-elasticsearch-indexing>)

Author: Alexandre Zajac

Published: 2026-06-15T15:30:53Z

Content type: article

Language: en

Sources: [Hungry Minds](<https://devfeed.tech/sources/hungry-minds.md>)

Topics: [elasticsearch](<https://devfeed.tech/topics/elasticsearch.md>), [Software Engineering](<https://devfeed.tech/topics/software-engineering.md>), [Database](<https://devfeed.tech/topics/database.md>), [observability](<https://devfeed.tech/topics/observability.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [database](<https://devfeed.tech/tags/database.md>), [elasticsearch](<https://devfeed.tech/tags/elasticsearch.md>), [implementation](<https://devfeed.tech/tags/implementation.md>), [observability](<https://devfeed.tech/tags/observability.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [rate-limiting](<https://devfeed.tech/tags/rate-limiting.md>)

## AI overview

The article describes Palantir's Elasticsearch reindexing system, which rebuilds large search indices while live traffic continues. It uses shadow indices, parallel database-to-index pipelines, multidimensional rate limiting, crash-safe state tracking, and support for multiple clusters.

## Source excerpt

PLUS: Claude skills guide 👨💻, Call queue architecture ⚡, when NOT to use Kafka 👨💻