# screensuite

Benchmarking suite for evaluating graphical user interface agents.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## ScreenSuite - The most comprehensive evaluation suite for GUI Agents!

DevFeed: [ScreenSuite - The most comprehensive evaluation suite for GUI Agents!](<https://devfeed.tech/articles/screensuite-the-most-comprehensive-evaluation-suite-for-gui-agents-7468.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/screensuite>)

Author: Amir Mahla; Aymeric Roucher; Thomas Wolf

Published: 2025-06-06T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [screensuite](<https://devfeed.tech/topics/screensuite.md>), [gui-agents](<https://devfeed.tech/topics/gui-agents.md>), [computer-use](<https://devfeed.tech/topics/computer-use.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Claude](<https://devfeed.tech/topics/claude.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [computer-use](<https://devfeed.tech/tags/computer-use.md>), [docker](<https://devfeed.tech/tags/docker.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [gui](<https://devfeed.tech/tags/gui.md>), [gui-agents](<https://devfeed.tech/tags/gui-agents.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [screensuite](<https://devfeed.tech/tags/screensuite.md>), [smolagents](<https://devfeed.tech/tags/smolagents.md>), [virtual-machines](<https://devfeed.tech/tags/virtual-machines.md>), [vlm](<https://devfeed.tech/tags/vlm.md>), [vlms](<https://devfeed.tech/tags/vlms.md>)

### AI overview

ScreenSuite is an open benchmarking and evaluation suite for GUI agents. It unifies 13 benchmarks covering perception, grounding, single-step actions, and multi-step agentic capabilities for Vision Language Models, with support for remote desktop sandboxes and Ubuntu or Android virtual machines launched in Docker.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.