# Build a Validated Kubernetes Runtime for NVIDIA Dynamo

DevFeed: [Build a Validated Kubernetes Runtime for NVIDIA Dynamo](<https://devfeed.tech/articles/build-a-validated-kubernetes-runtime-for-nvidia-dynamo-109506.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/build-a-validated-kubernetes-runtime-for-nvidia-dynamo/>)

Author: Stefan Schimanski

Published: 2026-10-30T21:35:31Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Dynamo](<https://devfeed.tech/topics/dynamo.md>), [NVIDIA DSX](<https://devfeed.tech/topics/nvidia-dsx.md>), [TensorRT-LLM](<https://devfeed.tech/topics/tensorrt-llm.md>), [GB300 NVL72](<https://devfeed.tech/topics/gb300-nvl72.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>)

Tags: [1-4](<https://devfeed.tech/tags/1-4.md>), [1-5](<https://devfeed.tech/tags/1-5.md>), [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-applications](<https://devfeed.tech/tags/ai-applications.md>), [applications](<https://devfeed.tech/tags/applications.md>), [build](<https://devfeed.tech/tags/build.md>), [building](<https://devfeed.tech/tags/building.md>), [building-ai-applications](<https://devfeed.tech/tags/building-ai-applications.md>), [cloud-services](<https://devfeed.tech/tags/cloud-services.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [distributed-inference](<https://devfeed.tech/tags/distributed-inference.md>), [dsx](<https://devfeed.tech/tags/dsx.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [model](<https://devfeed.tech/tags/model.md>), [need](<https://devfeed.tech/tags/need.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-dynamo](<https://devfeed.tech/tags/nvidia-dynamo.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [nvlink](<https://devfeed.tech/tags/nvlink.md>), [runtime](<https://devfeed.tech/tags/runtime.md>), [teams](<https://devfeed.tech/tags/teams.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

## AI overview

AICR packages NVIDIA Dynamo with pinned, compatibility-checked Kubernetes runtime components and validates the cluster before an application workload is installed. The workflow snapshots the cluster, generates a Dynamo inference recipe, renders and deploys a Helm or GitOps bundle, then runs deployment and conformance checks; performance validation is separate because it consumes test GPUs. Dynamo supports two routing paths: its Frontend selects workers and forwards requests, suited to model-specific endpoints and the smaller, more production-proven topology; or Gateway API with GAIE and Dynamo EPP selects endpoints while the Gateway handles forwarding, timeouts, retries, and fallback. Both use worker-reported KV-cache events for cache-aware placement. The excerpt notes that AICR's default request plane uses TCP and its KV event plane uses ZMQ; NATS is optional. It also describes an expected Dynamo 1.5 native Rust EPP replacing the 1.4 Go/CGO bridge.

## Source excerpt

Teams building AI applications need a repeatable path from a model configuration to a working inference endpoint. NVIDIA Dynamo is a distributed inference...