# How the D. E. Shaw group powers high-cardinality observability at scale with ClickHouse

DevFeed: [How the D. E. Shaw group powers high-cardinality observability at scale with ClickHouse](<https://devfeed.tech/articles/how-the-d-e-shaw-group-powers-high-cardinality-observability-at-scale-with-clickhouse-5226.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/deshaw>)

Author: ClickHouse

Published: 2026-05-15T00:00:00Z

Content type: article

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [observability](<https://devfeed.tech/topics/observability.md>), [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [Prometheus](<https://devfeed.tech/topics/prometheus.md>), [Time Series](<https://devfeed.tech/topics/time-series.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [tracing](<https://devfeed.tech/topics/tracing.md>)

Tags: [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [compression](<https://devfeed.tech/tags/compression.md>), [compute](<https://devfeed.tech/tags/compute.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [observability](<https://devfeed.tech/tags/observability.md>), [performance](<https://devfeed.tech/tags/performance.md>), [production](<https://devfeed.tech/tags/production.md>), [prometheus](<https://devfeed.tech/tags/prometheus.md>), [scale](<https://devfeed.tech/tags/scale.md>), [site-reliability](<https://devfeed.tech/tags/site-reliability.md>), [systems](<https://devfeed.tech/tags/systems.md>), [time-series](<https://devfeed.tech/tags/time-series.md>), [tracing](<https://devfeed.tech/tags/tracing.md>)

## AI overview

The D. E. Shaw group uses ClickHouse for high-cardinality observability across millions of compute workloads on its internal grid. The article describes evaluation results showing approximately 7x better performance than alternatives, production ingestion exceeding 500,000 records per second, and improved long-term capacity planning and tracing analysis.

## Source excerpt

How the D. E. Shaw group replaced its previous observability platform with ClickHouse to handle high-cardinality metrics at scale, achieving 7x better query performance and enabling multi-year capacity planning across millions of compute workloads.