# Using profiles of cognitive capability to assess AI suitability for workplace tasks

DevFeed: [Using profiles of cognitive capability to assess AI suitability for workplace tasks](<https://devfeed.tech/articles/using-profiles-of-cognitive-capability-to-assess-ai-suitability-for-workplace-tasks-118259.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2608.25623>)

Author: Jonathan Prunty, Marko Te\\v{s}i\\'c, Patrick Quinn, Jos\\'e Hern\\'andez-Orallo, Lucy Cheke

Published: 2026-11-05T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Machine Intelligence](<https://devfeed.tech/topics/machine-intelligence.md>), [Complex AI tasks](<https://devfeed.tech/topics/complex-ai-tasks.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-systems](<https://devfeed.tech/tags/ai-systems.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [capabilities](<https://devfeed.tech/tags/capabilities.md>), [core](<https://devfeed.tech/tags/core.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cy](<https://devfeed.tech/tags/cs-cy.md>), [cs-hc](<https://devfeed.tech/tags/cs-hc.md>), [dimensions](<https://devfeed.tech/tags/dimensions.md>), [domain](<https://devfeed.tech/tags/domain.md>), [domains](<https://devfeed.tech/tags/domains.md>), [employees](<https://devfeed.tech/tags/employees.md>), [experts](<https://devfeed.tech/tags/experts.md>), [framework](<https://devfeed.tech/tags/framework.md>), [machine](<https://devfeed.tech/tags/machine.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [profiling](<https://devfeed.tech/tags/profiling.md>), [requirements](<https://devfeed.tech/tags/requirements.md>), [tasks](<https://devfeed.tech/tags/tasks.md>), [workplace](<https://devfeed.tech/tags/workplace.md>)

## AI overview

The framework estimates AI suitability for workplace tasks by comparing two profiles built on shared cognitive dimensions: agent capabilities inferred from an annotated benchmark battery, and task requirements weighted by domain experts. The profiles can be updated independently and combined at the level of a domain, organisation, role, or duty. The authors validate capability recovery on synthetic agents, profile six AI systems, and collect task requirements from 410 employees across six occupational domains. They report that systems varied more across cognitive dimensions than across model families, while workplace activities shared a cognitive core. The scores are presented as a comparative aid for selecting candidates for pilots and identifying tasks where current systems may be poorly suited; the abstract does not claim they establish that a task should be automated.

## Source excerpt

arXiv:2608.25623v2 Announce Type: replace Abstract: Organisations deploying AI face a scoping problem: which tasks can be automated, which should remain with humans, and which are best shared between the two. Aggregate benchmark scores provide little insight into where systems will succeed or fail in practice, while human judgements of model capabilities quickly become outdated. We introduce a pipeline that profiles agents and tasks using a shared set of core cognitive capabilities. Cognitive capability profiling infers an agent's capabilities from performance on a benchmark battery annotated for the cognitive demands of each item. Task requirements weighting elicits from domain experts the relative importance of these same capabilities for their work. As both use a common set of cognitive dimensions, they can be updated independently as models and roles change, and combined to estimate AI suitability at the level of a domain, organisation, role, or individual duty. We validate capability recovery on synthetic agents, profile six AI systems, and elicit task requirements from 410 employees across six occupational domains. AI systems differed more across cognitive dimensions than across model families, while workplace activities converged on a shared cognitive core. The resulting scores provide a comparative scoping tool for identifying promising candidates for piloting and areas where current systems are unlikely to be well suited. We discuss extending the framework to profile human workers alongside AI systems, moving from AI suitability towards human-machine task allocation.