# I Built a 256GB Local AI Cluster on My Desk

DevFeed: [I Built a 256GB Local AI Cluster on My Desk](<https://devfeed.tech/articles/i-built-a-256gb-local-ai-cluster-on-my-desk-10592.md>)

Original publisher: [Read original article](<https://technotim.com/posts/local-ai-gx10/>)

Author: Techno Tim

Published: 2026-05-18T13:00:00Z

Content type: article

Language: en

Sources: [Techno Tim](<https://devfeed.tech/sources/techno-tim.md>)

Topics: [Local AI](<https://devfeed.tech/topics/local-ai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [agentic-coding](<https://devfeed.tech/topics/agentic-coding.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>), [Homelab](<https://devfeed.tech/topics/homelab.md>), [coding](<https://devfeed.tech/topics/coding.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [networking](<https://devfeed.tech/topics/networking.md>), [Docker](<https://devfeed.tech/topics/docker.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>)

Tags: [agentic-coding](<https://devfeed.tech/tags/agentic-coding.md>), [ai](<https://devfeed.tech/tags/ai.md>), [docker](<https://devfeed.tech/tags/docker.md>), [github](<https://devfeed.tech/tags/github.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [homelab](<https://devfeed.tech/tags/homelab.md>), [local-ai](<https://devfeed.tech/tags/local-ai.md>), [model-serving](<https://devfeed.tech/tags/model-serving.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [nccl](<https://devfeed.tech/tags/nccl.md>), [networking](<https://devfeed.tech/tags/networking.md>), [self-hosted](<https://devfeed.tech/tags/self-hosted.md>), [self-hosted-ai](<https://devfeed.tech/tags/self-hosted-ai.md>), [server](<https://devfeed.tech/tags/server.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

## AI overview

The article tests a two-node local AI cluster built from ASUS Ascent GX10 systems, using one machine for practical agentic coding and two machines to run a larger local model. It evaluates a real coding workflow involving model serving, storage, networking, memory, Docker, NCCL, monitoring, power draw, and the application being built, concluding that local AI is capable and cloud-independent but still operationally complex.

## Source excerpt

I have been covering local and self-hosted AI for a few years now - from running models privately at home to what is still running in my homelab today. But to run the larger, more capable models, you need something more specialized than a general-purpose home server. I wanted to know how good local AI has actually gotten, so I built a mini AI cluster on my desk and used it for a real coding wo...