# Introducing Infinity: a runtime for extreme agent concurrency

DevFeed: [Introducing Infinity: a runtime for extreme agent concurrency](<https://devfeed.tech/articles/introducing-infinity-a-runtime-for-extreme-agent-concurrency-97723.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/opensource/introducing-infinity-a-runtime-for-extreme-agent-concurrency/>)

Author: Shadaj Laddad

Published: 2026-10-23T16:58:32Z

Content type: release

Language: en

Sources: [AWS Open Source Blog](<https://devfeed.tech/sources/aws-open-source-blog.md>)

Topics: [Agent Harness](<https://devfeed.tech/topics/agent-harness.md>), [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [agent to agent communication](<https://devfeed.tech/topics/agent-to-agent-communication.md>), [async](<https://devfeed.tech/topics/async.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [scheduling](<https://devfeed.tech/topics/scheduling.md>)

Tags: [about](<https://devfeed.tech/tags/about.md>), [acme](<https://devfeed.tech/tags/acme.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-harnesses](<https://devfeed.tech/tags/agent-harnesses.md>), [agents](<https://devfeed.tech/tags/agents.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [build](<https://devfeed.tech/tags/build.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-agent](<https://devfeed.tech/tags/coding-agent.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [minutes](<https://devfeed.tech/tags/minutes.md>), [next](<https://devfeed.tech/tags/next.md>), [pull-request](<https://devfeed.tech/tags/pull-request.md>), [repository](<https://devfeed.tech/tags/repository.md>), [request](<https://devfeed.tech/tags/request.md>), [run](<https://devfeed.tech/tags/run.md>), [runtime](<https://devfeed.tech/tags/runtime.md>), [time](<https://devfeed.tech/tags/time.md>), [tools](<https://devfeed.tech/tags/tools.md>), [triage](<https://devfeed.tech/tags/triage.md>), [waiting](<https://devfeed.tech/tags/waiting.md>)

## AI overview

Infinity is an early Apache 2.0 research runtime that suspends agents at tool calls, saves their conversation histories, and resumes them when queued messages arrive. Each bounded slice runs one model completion and dispatches at most one tool call, so idle agents hold no process or task; a benchmark reports about 100 KB per idle agent and an estimate of 75,000 agents in 8 GB under its tested setup. Per-thread queues preserve message order while different threads run in parallel. Step mode supports serverless execution, but requires durable state and queues, at-least-once delivery with deduplication, bounded slices, and serialized processing per thread; the AWS reference uses SQS FIFO, Lambda, Aurora DSQL, and DynamoDB. Synthetic tool calls represent later tool events and parent-child reports within model conversation formats. Events default to separate child threads, or can be added directly to the subscribing thread when marked associative. Open questions include how models handle interleaved events, scheduling priorities, compaction across agent trees, and event authenticity.

## Source excerpt

Agents spend much of their time waiting on tools. A coding agent may start a build that runs for twenty minutes, a triage agent may wait hours for the next pull request on a repository, and an assistant may wait until the next morning for an approval. Most agent harnesses run the agent loop as [...]