# Benchmarks and Obscurantism: A "red" line that should not be crossed

DevFeed: [Benchmarks and Obscurantism: A "red" line that should not be crossed](<https://devfeed.tech/articles/benchmarks-and-obscurantism-a-red-line-that-should-not-be-crossed-5220.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/databricks-reyden-benchmark-transparency-clickhouse>)

Author: Melvyn Peignon

Published: 2026-06-29T00:00:00Z

Content type: article

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [Low Latency](<https://devfeed.tech/topics/low-latency.md>), [configuration](<https://devfeed.tech/topics/configuration.md>), [Software](<https://devfeed.tech/topics/software.md>), [systems](<https://devfeed.tech/topics/systems.md>)

Tags: [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [insights](<https://devfeed.tech/tags/insights.md>), [latency](<https://devfeed.tech/tags/latency.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [software](<https://devfeed.tech/tags/software.md>), [systems](<https://devfeed.tech/tags/systems.md>), [testing](<https://devfeed.tech/tags/testing.md>)

## AI overview

ClickHouse examines Databricks' Reyden benchmark, arguing that the reported ClickHouse failure cannot be independently validated because key hardware, cost, configuration, cache, and methodology details were omitted. Its reproduction of the identified TPC-H SF1 and Q6 setup found no crash and reported about 420 QPS at sub-second P90 latency on one 30-vCPU node.

## Source excerpt

Benchmarks only matter when they can be inspected, challenged, and reproduced. Here's what we found when we tested Databricks' ClickHouse claim.