# How Ora benchmarks every major AI agent on Vercel

DevFeed: [How Ora benchmarks every major AI agent on Vercel](<https://devfeed.tech/articles/how-ora-benchmarks-every-major-ai-agent-on-vercel-745.md>)

Original publisher: [Read original article](<https://vercel.com/blog/how-ora-benchmarks-every-major-ai-agent-on-vercel>)

Author: Kevin Sundstrom

Published: 2026-08-21T21:00:00Z

Content type: article

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [Vercel](<https://devfeed.tech/topics/vercel.md>), [agent observability](<https://devfeed.tech/topics/agent-observability.md>), [Traces](<https://devfeed.tech/topics/traces.md>), [Claude Code](<https://devfeed.tech/topics/claude-code.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [ChatGPT](<https://devfeed.tech/topics/chatgpt.md>), [OpenClaw](<https://devfeed.tech/topics/openclaw.md>), [backends](<https://devfeed.tech/topics/backends.md>), [Front end](<https://devfeed.tech/topics/frontend.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [latency](<https://devfeed.tech/tags/latency.md>), [openclaw](<https://devfeed.tech/tags/openclaw.md>), [software](<https://devfeed.tech/tags/software.md>), [tools](<https://devfeed.tech/tags/tools.md>), [traces](<https://devfeed.tech/tags/traces.md>), [vercel](<https://devfeed.tech/tags/vercel.md>), [web](<https://devfeed.tech/tags/web.md>)

## AI overview

Ora benchmarks major AI agents by running them against live customer websites and recording the cost, latency, steps, and traces required to complete workflows. Built on Vercel, the platform provides the front end, back end, and agent runtime through one deployment path.

## Source excerpt

Ora on Vercel Front end, back end, and agent runtime on one platform Every major agent tested side by side on live sites Hundreds of commits a day from a 16-person engineering team Ora sends agents onto live websites with instructions to sign up for a product, integrate with it, and pay for it. Agents often fail, and by Ora's estimate, 99% of the web isn't agent-ready. The platform shows customers where and why agents fail, and what to change. Assaf Elovic, co-founder of Ora, spent years helping agents discover the web. His previous company, Tavily, built a web search engine for AI agents and was acquired by Nebius earlier this year. Search solved half the problem, but an agent that finds a product still has to actually use it. He and co-founder Liad Yosef started Ora to measure how ready the web is for agents, and to fix the parts that aren't. Today that means spawning agents against live customer sites from journey.ora.ai, where Ora runs a journey and records the cost, latency, and steps an agent needs to finish a task. The platform runs on Vercel, including the agent runtime. Benchmarking every major agent side by sideEvery harness expects its own infrastructure Agents decompose into two parts: a model, which does the reasoning, and a harness, the software that gives the model its tools and drives it from step to step. Ora's lineup covers the agents customers use most: Claude Code, ChatGPT, Gemini, Hermes, OpenClaw, and eve, Vercel's agent framework. Ora runs each agent on a customer's website and watches how it handles common workflows. No two harnesses want the same infrastructure. Each expects its own environment and exposes its steps differently, so Ora runs a separate runtime for every harness and traces every step. Ido Finder, who leads engineering at Ora, calls that side-by-side coverage one of the most valuable things ora brings to its customers. When an agent stalls in a signup flow, the customer sees which step and what it tried. Without the trace, the