# ScreenSuite - The most comprehensive evaluation suite for GUI Agents!

DevFeed: [ScreenSuite - The most comprehensive evaluation suite for GUI Agents!](<https://devfeed.tech/articles/screensuite-the-most-comprehensive-evaluation-suite-for-gui-agents-7468.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/screensuite>)

Author: Amir Mahla; Aymeric Roucher; Thomas Wolf

Published: 2025-06-06T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [screensuite](<https://devfeed.tech/topics/screensuite.md>), [gui-agents](<https://devfeed.tech/topics/gui-agents.md>), [computer-use](<https://devfeed.tech/topics/computer-use.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Claude](<https://devfeed.tech/topics/claude.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [computer-use](<https://devfeed.tech/tags/computer-use.md>), [docker](<https://devfeed.tech/tags/docker.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [gui](<https://devfeed.tech/tags/gui.md>), [gui-agents](<https://devfeed.tech/tags/gui-agents.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [screensuite](<https://devfeed.tech/tags/screensuite.md>), [smolagents](<https://devfeed.tech/tags/smolagents.md>), [virtual-machines](<https://devfeed.tech/tags/virtual-machines.md>), [vlm](<https://devfeed.tech/tags/vlm.md>), [vlms](<https://devfeed.tech/tags/vlms.md>)

## AI overview

ScreenSuite is an open benchmarking and evaluation suite for GUI agents. It unifies 13 benchmarks covering perception, grounding, single-step actions, and multi-step agentic capabilities for Vision Language Models, with support for remote desktop sandboxes and Ubuntu or Android virtual machines launched in Docker.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.