# leaderboards Published articles for leaderboards. This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles. ## Benchmaxxing: When the Benchmark Becomes the Target DevFeed: [Benchmaxxing: When the Benchmark Becomes the Target]() Original publisher: [Read original article]() Author: Nathan Danneman Published: 2026-09-12T11:17:51.295154Z Content type: article Language: en Sources: [Blog]() Topics: [Benchmark](), [Artificial Intelligence](), [Cybersecurity](), [Ground truth / benchmark quality](), [Detection engineering]() Tags: [ai](), [ai-and-cybersecurity](), [benchmark](), [benchmarking](), [benchmarks](), [blog](), [cybersecurity](), [leaderboards](), [securing-ai](), [security](), [validation]() ### AI overview The article explains how public AI and cybersecurity benchmarks can become targets for optimization, a practice it calls "benchmaxxing." It argues that gaming, ceiling effects, data leakage, binary scoring, omitted costs, and aggregate scores can make benchmark results poor proxies for real-world defensive capability. The article proposes task-coupled internal benchmarks intended to evaluate end-to-end cyber agents and support rigorous science rather than visibility-driven score optimization. ### Source excerpt The more attention a benchmark receives, the stronger the incentive to optimize for it. In AI and cybersecurity, this can have significant consequences. ## Squingle Arcade Is Available Now For Free On PC VR DevFeed: [Squingle Arcade Is Available Now For Free On PC VR]() Original publisher: [Read original article]() Author: Mike Johnson Published: 2026-09-10T00:14:39Z Content type: news Language: en Sources: [UploadVR]() Topics: [arcade](), [Mazes](), [pc]() Tags: [free](), [leaderboards](), [multiplayer](), [orbs](), [pc](), [puzzle](), [vr-gaming]() ### AI overview Squingle Arcade, a free-to-play quickplay version of the fluid-maze puzzle game Squingle, is now available on SteamVR and Quest. It includes more than 60 levels, asynchronous multiplayer, ghost racing, leaderboards, and scalable mazes. ### Source excerpt Squingle Arcade, the follow up to the original fluid-maze-navigating puzzle game Squingle, is out now for PC VR. ## DeepSeek overtakes Google on volume, cost per token falls 13.6% DevFeed: [DeepSeek overtakes Google on volume, cost per token falls 13.6%]() Original publisher: [Read original article]() Author: Harpreet Arora Published: 2026-08-11T04:00:00Z Content type: news Language: en Sources: [Vercel News]() Topics: [AI Chat]() Tags: [agent](), [ai](), [ai-gateway](), [anthropic](), [applications](), [claude](), [cost](), [data](), [deepseek](), [enterprise](), [google](), [gpt](), [launch](), [leaderboards](), [media](), [models](), [openai](), [production](), [video](), [work]() ### AI overview The August AI Gateway Production Index reports that token prices fell 13.6% in July while token use and spending grew. DeepSeek surpassed Google for second place by token volume, while Kimi K3 and other open-weight models gained usage and spending. ### Source excerpt AI Gateway Production Index -- August 2026 Every month, AI Gateway routes tens of trillions of tokens between production applications and AI labs. That traffic gives us a view of what AI usage actually looks like in today's enterprise, and we publish it here monthly. See the Production Index reports from May, June, and July. August 2026 Summary The August index reports on AI Gateway data collected through July 2026. The average price paid per token fell 13.6% in July, after rising almost 20% in May and holding steady in June. Token consumption grew so quickly that even with 37% growth in spend, cost per token saw a double-digit drop. DeepSeek became the second-largest lab by token volume, now running more than twice Google's volume. Anthropic collected 65% of gateway spending on 30% of token volume, at 4.4 times the average price of every other lab's tokens. Both media leaderboards changed hands. Google's Nano Banana took the lead in image volume from OpenAI's GPT Image, and ByteDance's Seedance led video in both volume and dollars. Kimi K3 launched into agent work Moonshot released Kimi K3 on July 16. Like Z.ai's GLM 5.2 released in June, it is built for long-horizon agent work, so its usage was heavy from the start at about twelve times the tokens per request of its predecessor, K2.5. It scaled quickly. K3's daily volume tripled between launch week and the final week of July, and by month end its requests were as heavy as Claude Opus 4.8's. On the last full day of July it ranked eighth on the gateway by token volume. The demand was new rather than diverted. K3 processed nearly two-thirds of all Kimi tokens within two weeks and 82% by the final week, while the rest of the family's volume fell only slightly. Open weight's share of gateway spend more than doubled in July to 8.6%. More than 90% of that growth is Moonshot and Z.ai. Moonshot's share of total gateway spend quadrupled, to 2.3%. Cheap open-weight models have been taking volume for months without taking reve ## Building Internal Flashboards in Slack with AI DevFeed: [Building Internal Flashboards in Slack with AI]() Original publisher: [Read original article]() Author: WorkOS Published: 2026-08-10T16:15:41Z Content type: article Language: en Sources: [WorkOS Blog]() Topics: [Slack](), [dashboards](), [Artificial Intelligence](), [Claude](), [data](), [API](), [HTML]() Tags: [agent](), [ai](), [api](), [claude](), [code-generation](), [html](), [leaderboards](), [reporting](), [slack]() ### AI overview WorkOS describes Flashboards, an internal reporting tool built as documents with live data connections and edited through AI agents in Slack. The article explains its HTML-based architecture, read-only data access, employee authentication, natural-language creation workflow, interactive filters, and versioned iteration. ### Source excerpt Flashboards is WorkOS's internal reporting tool: a doc with a live data connection, and agents as the only editing interface. Zero to 55 weekly readers in seven weeks. ## Community Evals: Because we're done trusting black-box leaderboards over the community DevFeed: [Community Evals: Because we're done trusting black-box leaderboards over the community]() Original publisher: [Read original article]() Author: ben burtenshaw; Nathan Habib; Bertrand Chevrier; merve; Daniel van Strien; Niels Rogge; Julien Chaumond Published: 2026-02-04T00:00:00Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [ai observability]() Tags: [artificial-intelligence](), [benchmark](), [community](), [datasets](), [evaluation](), [git](), [hub](), [hugging-face](), [leaderboard](), [leaderboards](), [models](), [open](), [open-source](), [pull-requests]() ### AI overview Hugging Face introduces community-reported benchmark evaluations and dataset-hosted leaderboards, with reproducible specifications, pull-request submissions, and verification badges. ### Source excerpt We're on a journey to advance and democratize artificial intelligence through open source and open science. ## Gaia2 and ARE: Empowering the community to study agents DevFeed: [Gaia2 and ARE: Empowering the community to study agents]() Original publisher: [Read original article]() Author: Clémentine Fourrier; Grégoire Mialon; Maxime Lecanu; Pierre Andrews; Adrien Carreira; frere thibaud; Avijit Ghosh; Romain Froger; Dheeraj Mekala; Caroline Pascal Published: 2025-09-22T00:00:00Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [gaia](), [Benchmark](), [Framework](), [Open Source](), [debugging]() Tags: [agents](), [apis](), [artificial-intelligence](), [benchmark](), [collaboration](), [complexity](), [dataset](), [debug](), [evaluation](), [gaia](), [leaderboards](), [open-source](), [reasoning](), [simulation](), [time]() ### AI overview The article introduces Gaia2, a harder follow-up to the GAIA benchmark for evaluating interactive AI agents. Gaia2 expands evaluation from read-only information retrieval to read-and-write tasks involving tool use, web browsing, ambiguous and time-sensitive instructions, controlled failures, adaptability, and agent-to-agent collaboration. It is released with the open Meta Agents Research Environments (ARE) framework, which supports running, debugging, and evaluating agents in customizable simulated real-world conditions. ### Source excerpt We're on a journey to advance and democratize artificial intelligence through open source and open science. ## Arabic Leaderboards: Introducing Arabic Instruction Following, Updating AraGen, and More DevFeed: [Arabic Leaderboards: Introducing Arabic Instruction Following, Updating AraGen, and More]() Original publisher: [Read original article]() Author: Ali El Filali; Sarah AlBarri; Abouelseoud; samta kamboj; Neha Sengupta; Preslav Nakov Published: 2025-04-08T00:00:00Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [LLM evaluation / benchmarking](), [Benchmark](), [datasets](), [AI Models](), [Open Source]() Tags: [arabic](), [benchmark](), [community](), [datasets](), [evaluation](), [leaderboard](), [leaderboards](), [llm](), [nlp](), [open-source](), [reasoning](), [research](), [safety]() ### AI overview This article announces Arabic-Leaderboards, a unified platform for Arabic AI evaluations, and introduces Arabic Instruction Following powered by the Arabic IFEval Benchmark. It also presents an updated AraGen release with a larger 340-pair evaluation dataset and publicly releases the AraGen-12-24 benchmark and model responses evaluated by Claude-3.5-Sonnet under the 3C3H guidelines. ### Source excerpt We're on a journey to advance and democratize artificial intelligence through open source and open science. ## Building real-time leaderboards with Tinybird DevFeed: [Building real-time leaderboards with Tinybird]() Original publisher: [Read original article]() Author: Jim Moffitt Published: 2024-06-06T00:00:00Z Content type: article Language: en Sources: [Tinybird]() Topics: [real-time](), [data]() Tags: [analytics](), [building](), [data](), [i-built-this](), [leaderboards](), [real-time]() ### AI overview A tutorial-style article about building real-time leaderboards with Tinybird, using live data and real-time analytics that update in milliseconds. ### Source excerpt Build real-time leaderboards using Tinybird. Engage users with live data and real-time analytics that update in milliseconds. ## Improving Prompt Consistency with Structured Generations DevFeed: [Improving Prompt Consistency with Structured Generations]() Original publisher: [Read original article]() Author: Will Kurt; Remi Louf; Clémentine Fourrier Published: 2024-04-30T00:00:00Z Content type: article Language: en Sources: [Hugging Face - Blog]() Topics: [Prompt Engineering](), [Benchmark](), [Large Language Model](), [tokenization](), [Human-AI evaluation]() Tags: [benchmark](), [collaboration](), [compare](), [consistency](), [evals](), [evaluation](), [leaderboard](), [leaderboards](), [prompt](), [research](), [tokenization]() ### AI overview The article examines how superficial changes to prompt formatting can substantially affect large language model benchmark scores and model rankings. Using MMLU evaluations across multiple prompt formats and models, it shows that prompt structure introduces significant variance, sometimes because of tokenizer issues, and motivates structured generations to improve consistency. ### Source excerpt We're on a journey to advance and democratize artificial intelligence through open source and open science. ## Roboflow.com choose Supabase to power Paint.wtf leaderboard DevFeed: [Roboflow.com choose Supabase to power Paint.wtf leaderboard]() Original publisher: [Read original article]() Author: Rory Wilding Published: 2021-02-09T07:00:00Z Content type: article Language: en Sources: [Supabase Blog]() Topics: [Supabase](), [Artificial Intelligence](), [PostgreSQL](), [BigQuery](), [Firebase]() Tags: [ai](), [applications](), [computer-vision](), [data](), [developers](), [experiment](), [image](), [images](), [launch](), [leaderboards](), [news](), [openai](), [performance](), [postgresql](), [product](), [startup](), [use-cases]() ### AI overview Roboflow used Supabase and PostgreSQL to build the leaderboard for Paint.wtf, a weekend project that uses OpenAI's CLIP model to score users' drawings against text prompts. The product handled more than 100,000 drawing submissions in 24 hours after gaining attention on Hacker News, Reddit, and Product Hunt. ### Source excerpt Learn how Roboflow.com used Supabase to build their Paint.wtf leaderboard