# Our Transformers Code Agent beats the GAIA benchmark 🏅

DevFeed: [Our Transformers Code Agent beats the GAIA benchmark 🏅](<https://devfeed.tech/articles/our-transformers-code-agent-beats-the-gaia-benchmark-7123.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/beating-gaia>)

Author: Aymeric Roucher; Sergei Petrov

Published: 2024-07-01T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [gaia](<https://devfeed.tech/topics/gaia.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [smolagents](<https://devfeed.tech/topics/smolagents.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Graphs](<https://devfeed.tech/topics/graphs.md>), [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [code](<https://devfeed.tech/tags/code.md>), [community](<https://devfeed.tech/tags/community.md>), [gaia](<https://devfeed.tech/tags/gaia.md>), [leaderboard](<https://devfeed.tech/tags/leaderboard.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [research](<https://devfeed.tech/tags/research.md>), [retrieval-augmented-generation](<https://devfeed.tech/tags/retrieval-augmented-generation.md>), [smolagents](<https://devfeed.tech/tags/smolagents.md>), [tool](<https://devfeed.tech/tags/tool.md>), [tools](<https://devfeed.tech/tags/tools.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

## AI overview

The article presents a Transformers Code Agent that achieved top performance on the GAIA benchmark. It explains how LLM-based agents use tools and dynamically change their execution graph, and notes that the framework has since been upgraded to the standalone smolagents library.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.