# Benchmarking Omni's agentic analytics harness

DevFeed: [Benchmarking Omni's agentic analytics harness](<https://devfeed.tech/articles/benchmarking-omni-s-agentic-analytics-harness-82474.md>)

Original publisher: [Read original article](<https://omni.co/blog/benchmarking-omnis-agentic-analytics-harness>)

Author: Colin Zima

Published: 2026-07-28T16:00:00Z

Content type: comparison

Language: en

Sources: [Omni Blog](<https://devfeed.tech/sources/omni-blog.md>)

Topics: [Agent Harness](<https://devfeed.tech/topics/agent-harness.md>), [product analytics](<https://devfeed.tech/topics/product-analytics.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>), [A/B Testing](<https://devfeed.tech/topics/a-b-testing.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [harness](<https://devfeed.tech/tags/harness.md>)

## AI overview

Omni compares its agentic analytics harness with four other AI setups using 100 questions from its production instance. It reports that Omni answered 95 correctly, returned consistent answers across repeated runs, and was faster and less expensive per correct answer than the next-best alternative. The article attributes the results mainly to a harness that routes questions through curated semantic model topics, compiles queries into SQL, and validates answers. It notes that the benchmark is directional and that results may differ across warehouses.

## Source excerpt

We took 100 real questions our team had asked in our own production Omni instance, and tested five AI setups using the same questions, data, and warehouse. The results show Omni is better, faster, and less expensive.