# Serving DeepSeek-V4.1-Flash at Scale: vLLM Matches DeepInfer and Scales to GB300 NVL72

DevFeed: [Serving DeepSeek-V4.1-Flash at Scale: vLLM Matches DeepInfer and Scales to GB300 NVL72](<https://devfeed.tech/articles/serving-deepseek-v4-1-flash-at-scale-vllm-matches-deepinfer-and-scales-to-gb300-nvl72-98978.md>)

Original publisher: [Read original article](<https://vllm.ai/blog/2026-10-23-deepseek-v41-flash-pd-wide-ep>)

Author: Inferact and the vLLM Team

Published: 2026-10-23T00:00:00Z

Content type: article

Language: en

Sources: [vLLM Blog](<https://devfeed.tech/sources/vllm-blog.md>)

Topics: [vllm](<https://devfeed.tech/topics/vllm.md>), [GB300 NVL72](<https://devfeed.tech/topics/gb300-nvl72.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai-engineering](<https://devfeed.tech/tags/ai-engineering.md>), [async](<https://devfeed.tech/tags/async.md>), [attention](<https://devfeed.tech/tags/attention.md>), [b300](<https://devfeed.tech/tags/b300.md>), [balancing](<https://devfeed.tech/tags/balancing.md>), [deepinfer](<https://devfeed.tech/tags/deepinfer.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [deepseek-v4-1-flash](<https://devfeed.tech/tags/deepseek-v4-1-flash.md>), [disaggregation](<https://devfeed.tech/tags/disaggregation.md>), [gb300](<https://devfeed.tech/tags/gb300.md>), [gb300-nvl72](<https://devfeed.tech/tags/gb300-nvl72.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [large-scale-serving](<https://devfeed.tech/tags/large-scale-serving.md>), [llm-inference](<https://devfeed.tech/tags/llm-inference.md>), [model-serving](<https://devfeed.tech/tags/model-serving.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [open-source-ai](<https://devfeed.tech/tags/open-source-ai.md>), [performance](<https://devfeed.tech/tags/performance.md>), [rack](<https://devfeed.tech/tags/rack.md>), [scale](<https://devfeed.tech/tags/scale.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [user](<https://devfeed.tech/tags/user.md>), [v4-1-flash](<https://devfeed.tech/tags/v4-1-flash.md>), [vllm](<https://devfeed.tech/tags/vllm.md>), [vllm-blog](<https://devfeed.tech/tags/vllm-blog.md>), [wide](<https://devfeed.tech/tags/wide.md>)

## AI overview

On one GB300 NVL72 rack, vLLM's P/D-disaggregated, Wide-EP serving of DeepSeek-V4.1-Flash reaches 954K tokens/s per GPU on SemiAnalysis AgentX at a P90 of 196 tokens/s per user, reported as 7.9x the authors' earlier single-node result. Decode throughput on GB200 is within 6% of DeepSeek's DeepInfer across batch sizes 8-256; the prefill curves track, though differing setups prevent a direct speedup comparison. The reported gains come from fitting prefill to DEP2, extending bounded replay to layer 20, using larger GPU pages for shared Engram tables and DeepSelect for prefill ranking, plus Wide-EP with EPLB for decode. At DEP32, EPLB substantially improves expert-load balance, while CPU overhead can erase GPU-side scaling gains. A specialized decode path reaches 826 P90 tokens/s for one user on four B300 GPUs, 44% above the standard path. Results depend on the stated hardware, configurations and workloads.

## Source excerpt

With P/D disaggregation and Wide-EP on a GB300 NVL72 rack, vLLM serves DeepSeek-V4.1-Flash on SemiAnalysis AgentX at 954K tokens/s per GPU at a P90 of 196 tokens/s per user, 7.9x our aggregated single-node result.