# DeepSeek-V4.1-Flash on Vera Rubin NVL72: 58x Throughput vs. GB300 NVL72 at 387 tokens/s

DevFeed: [DeepSeek-V4.1-Flash on Vera Rubin NVL72: 58x Throughput vs. GB300 NVL72 at 387 tokens/s](<https://devfeed.tech/articles/deepseek-v4-1-flash-on-vera-rubin-nvl72-58x-throughput-vs-gb300-nvl72-at-387-tokens-s-132530.md>)

Original publisher: [Read original article](<https://vllm.ai/blog/2026-11-12-deepseek-v41-flash-vera-rubin>)

Author: Inferact and the vLLM Team

Published: 2026-11-12T00:00:00Z

Content type: news

Language: en

Sources: [vLLM Blog](<https://devfeed.tech/sources/vllm-blog.md>)

Topics: [Vera Rubin NVL72](<https://devfeed.tech/topics/vera-rubin-nvl72.md>), [performance-engineering](<https://devfeed.tech/topics/performance-engineering.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai-engineering](<https://devfeed.tech/tags/ai-engineering.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [deepseek-v4-1-flash](<https://devfeed.tech/tags/deepseek-v4-1-flash.md>), [disaggregation](<https://devfeed.tech/tags/disaggregation.md>), [gb300](<https://devfeed.tech/tags/gb300.md>), [gb300-nvl72](<https://devfeed.tech/tags/gb300-nvl72.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [large-scale-serving](<https://devfeed.tech/tags/large-scale-serving.md>), [llm-inference](<https://devfeed.tech/tags/llm-inference.md>), [model-serving](<https://devfeed.tech/tags/model-serving.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-vera](<https://devfeed.tech/tags/nvidia-vera.md>), [nvidia-vera-rubin](<https://devfeed.tech/tags/nvidia-vera-rubin.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [open-source-ai](<https://devfeed.tech/tags/open-source-ai.md>), [performance](<https://devfeed.tech/tags/performance.md>), [rack](<https://devfeed.tech/tags/rack.md>), [rubin](<https://devfeed.tech/tags/rubin.md>), [semianalysis](<https://devfeed.tech/tags/semianalysis.md>), [throughput](<https://devfeed.tech/tags/throughput.md>), [v4-1-flash](<https://devfeed.tech/tags/v4-1-flash.md>), [vera](<https://devfeed.tech/tags/vera.md>), [vera-rubin](<https://devfeed.tech/tags/vera-rubin.md>), [vera-rubin-nvl72](<https://devfeed.tech/tags/vera-rubin-nvl72.md>), [vllm](<https://devfeed.tech/tags/vllm.md>), [vllm-blog](<https://devfeed.tech/tags/vllm-blog.md>)

## AI overview

On a Vera Rubin NVL72 rack, vLLM reports 1.7M tokens/s per GPU on DeepSeek-V4.1-Flash at 387 tokens/s per user, described as 58x GB300 NVL72 at the same interactivity. The gains come from kernels adapted to Rubin's separate memory domains and wider FP4-capable MMA instructions, a specialized TP8 decode path, and shared rack memory pools. The excerpt reports roughly 28% faster DEP2 prefill steps and 25% faster DEP32 decode steps; TP8 reaches 1,810 tokens/s at batch size 1 in the TL;DR. Mooncake pools KV data across DRAM and spare HBM, while Engram tables are split across GPU HBM and accessed over NVLink. At concurrency 4,800, pools plus workload-aware routing on three DEP2 instances serve 68% more requests, reduce TTFT P50 from 29.8 to 4.2 seconds, and raise prefix hit rate from 91.8% to 96.1%. The HBM pool is described as experimental.

## Source excerpt

On one NVIDIA Vera Rubin NVL72 rack, vLLM serves DeepSeek-V4.1-Flash on SemiAnalysis AgentX at 1.7M tokens/s per GPU at a P90 of 387 tokens/s per user, 58x GB300 NVL72 at the same interactivity.