# Automatic local AI model routing with NVIDIA Switchyard

DevFeed: [Automatic local AI model routing with NVIDIA Switchyard](<https://devfeed.tech/articles/automatic-local-ai-model-routing-with-nvidia-switchyard-65109.md>)

Original publisher: [Read original article](<https://technotim.com/posts/switchyard-local-ai-routing/>)

Author: Techno Tim

Published: 2026-10-05T13:00:00Z

Content type: article

Language: en

Sources: [Techno Tim](<https://devfeed.tech/sources/techno-tim.md>)

Topics: [Model Routing](<https://devfeed.tech/topics/model-routing.md>), [Local AI](<https://devfeed.tech/topics/local-ai.md>), [gpt-oss](<https://devfeed.tech/topics/gpt-oss.md>), [CUDA Graphs](<https://devfeed.tech/topics/cuda-graphs.md>), [Nemotron](<https://devfeed.tech/topics/nemotron.md>), [Scapy](<https://devfeed.tech/topics/scapy.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [automation](<https://devfeed.tech/tags/automation.md>), [code](<https://devfeed.tech/tags/code.md>), [homelab](<https://devfeed.tech/tags/homelab.md>), [local-ai](<https://devfeed.tech/tags/local-ai.md>), [local-models](<https://devfeed.tech/tags/local-models.md>), [model](<https://devfeed.tech/tags/model.md>), [model-routing](<https://devfeed.tech/tags/model-routing.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>)

## AI overview

The article evaluates NVIDIA Switchyard for routing coding-agent requests between a faster local Nemotron model and a more capable DeepSeek model. It describes how increasing Nemotron's context window reduced fallback traffic, and reports that in one automated test-suite run, 87.7% of model selections stayed on Nemotron. The author also covers configuration, monitoring, benchmark limitations, and safeguards for a local deployment.

## Source excerpt

I've been running a few local models, and I don't really want to choose one before every request. A faster model might handle most of a coding task just fine, but sometimes the agent could run into a failing test or start chasing an error that needs a little more reasoning. I could send everything to the most capable model, but I'd also be waiting on it for work the faster one could have handle...