# genaimodels

Published articles for genaimodels.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Data Agent Benchmark for Multi-step Reasoning (DABstep)

DevFeed: [Data Agent Benchmark for Multi-step Reasoning (DABstep)](<https://devfeed.tech/articles/data-agent-benchmark-for-multi-step-reasoning-dabstep-26258.md>)

Original publisher: [Read original article](<https://medium.com/adyen/data-agent-benchmark-for-multi-step-reasoning-dabstep-70e913c339dc?source=rss----64941d9fbc09---4>)

Author: Adyen

Published: 2025-02-05T09:19:27Z

Content type: article

Language: en

Sources: [Adyen Tech](<https://devfeed.tech/sources/adyen-tech.md>)

Topics: [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [LLMs](<https://devfeed.tech/topics/llms.md>), [AI Bots](<https://devfeed.tech/topics/ai-bots.md>)

Tags: [adyen](<https://devfeed.tech/tags/adyen.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [data](<https://devfeed.tech/tags/data.md>), [data-agents](<https://devfeed.tech/tags/data-agents.md>), [data-analysis](<https://devfeed.tech/tags/data-analysis.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [genaimodels](<https://devfeed.tech/tags/genaimodels.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>)

### AI overview

Adyen and Hugging Face introduce DABstep, a benchmark with more than 450 data analysis tasks for evaluating language models and AI agents on multi-step reasoning. The article reports that the strongest reasoning-based agents achieved 16% accuracy, indicating that complex real-world data analysis remains difficult for current models.

### Source excerpt

Alex Egg (Adyen), Martin Iglesias (Adyen), Friso Kingma (Adyen), Andreu Mora (Adyen), Leandro Von Werra (HuggingFace), Thomas Wolf (HuggingFace) https://huggingface.co/spaces/adyen/DABstep 👉🏽 You can access DABStep with this link here: https://huggingface.co/spaces/adyen/DABstep Language models are becoming increasingly capable and can solve tasks autonomously as agents. There are many exciting use cases, especially at the intersection of reasoning, code, and data. However, proper evaluation benchmarks on real-world problems are lacking and hinder progress in the field. To tackle this challenge, Adyen and Hugging Face built the Data Agent Benchmark for Multi-step Reasoning (DABstep) together. DABstep consists of over 450 data analysis tasks designed to evaluate the capabilities of state-of-the-art LLMs and AI agents. Our findings reveal that DABstep presents a significant challenge for current AI models, with the most capable Reasoning-based agents achieving only 16% accuracy, highlighting significant progress to be made in the field. DABStep requires AI models to: dive in details of data and be rigorous (no hallucinations) reason over free form text and databases connect with real life use-cases (not just math or code) In this blog post, we'll cover the design and construction of the benchmark, explore evaluation results, and discuss the significant gap between current models and the ability to solve complex data analysis tasks effectively.. Motivation Data analysis is both an art and a science that requires technical skill, domain knowledge and creativity, and thus, it's rarely straightforward. Even seasoned data analysts face challenges like: Simple but time-consuming tasks: The sheer volume of even simple tasks often turns straightforward analysis into hours of repetitive work. Complex context and high cognitive load: Some tasks require analysis to juggle intricate domain-specific knowledge, making them both time-intensive and mentally draining. For example, (1)