# The Agentic Analytics Benchmark: Measuring model accuracy and efficiency in analytical agents

DevFeed: [The Agentic Analytics Benchmark: Measuring model accuracy and efficiency in analytical agents](<https://devfeed.tech/articles/the-agentic-analytics-benchmark-measuring-model-accuracy-and-efficiency-in-analytical-agents-4916.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/agentic-analytics-benchmark-data-agent-mnist>)

Author: Eduardo Vellasques; Al Brown

Published: 2026-09-01T19:15:00Z

Content type: article

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [text2sql](<https://devfeed.tech/topics/text2sql.md>), [Databases](<https://devfeed.tech/topics/databases.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [deepseek](<https://devfeed.tech/topics/deepseek.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agents](<https://devfeed.tech/tags/agents.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [claude](<https://devfeed.tech/tags/claude.md>), [cost](<https://devfeed.tech/tags/cost.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [model](<https://devfeed.tech/tags/model.md>), [speed](<https://devfeed.tech/tags/speed.md>), [sql](<https://devfeed.tech/tags/sql.md>)

## AI overview

The article introduces data-agent-mnist, an open benchmark harness for evaluating analytics agents against a data warehouse. It compares 29 models on correctness, cost, speed, and number of turns, and contrasts agentic analytics with conventional text-to-SQL evaluation.

## Source excerpt

We took 201 real analytics questions from our production data warehouse, benchmarked 29 models on correctness, cost, and speed, and released an open harness so you can run the same test on your own.