# CoreWeave Delivers Breakthrough AI Performance with NVIDIA GB200 and H200 GPUs in MLPerf Inference v5.0

DevFeed: [CoreWeave Delivers Breakthrough AI Performance with NVIDIA GB200 and H200 GPUs in MLPerf Inference v5.0](<https://devfeed.tech/articles/coreweave-delivers-breakthrough-ai-performance-with-nvidia-gb200-and-h200-gpus-in-mlperf-inference-v5-0-96104.md>)

Original publisher: [Read original article](<https://wf.coreweave.com/blog/coreweave-delivers-breakthrough-ai-performance-with-nvidia-gb200-and-h200-gpus-in-mlperf-inference-v5-0>)

Author: CoreWeave

Published: 2026-10-22T16:27:39Z

Content type: news

Language: en

Sources: [Coreweave Blog Posts](<https://devfeed.tech/sources/coreweave-blog-posts.md>)

Topics: [GB200](<https://devfeed.tech/topics/gb200.md>), [performance-engineering](<https://devfeed.tech/topics/performance-engineering.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [GPU optimization](<https://devfeed.tech/topics/gpu-optimization.md>), [quantization](<https://devfeed.tech/topics/quantization.md>)

Tags: [000](<https://devfeed.tech/tags/000.md>), [2](<https://devfeed.tech/tags/2.md>), [2023](<https://devfeed.tech/tags/2023.md>), [2025](<https://devfeed.tech/tags/2025.md>), [3](<https://devfeed.tech/tags/3.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-performance](<https://devfeed.tech/tags/ai-performance.md>), [content-type](<https://devfeed.tech/tags/content-type.md>), [coreweave](<https://devfeed.tech/tags/coreweave.md>), [gb200](<https://devfeed.tech/tags/gb200.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llama](<https://devfeed.tech/tags/llama.md>), [mlperf](<https://devfeed.tech/tags/mlperf.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [performance](<https://devfeed.tech/tags/performance.md>), [results](<https://devfeed.tech/tags/results.md>), [top](<https://devfeed.tech/tags/top.md>), [v5](<https://devfeed.tech/tags/v5.md>), [with](<https://devfeed.tech/tags/with.md>)

## AI overview

CoreWeave reports MLPerf Inference v5.0 results of over 800 tokens per second on Llama 3.1 405B using a GB200 instance with four Blackwell GPUs, and 33,000 tokens per second on Llama 2 70B using H200 GPUs. It says GB200 delivered 2.86x per-GPU throughput versus NVIDIA's H200 submission, while noting that the comparison uses FP4 for Blackwell and FP8 for H200. The H200 result was 40% above the fastest H100 submission for Llama 2 70B in v4.1, but the H200 used FP8 and that H100 result used FP16. The figures also use different MLPerf scenarios: GB200 Offline and H200 Server. CoreWeave attributes performance to its GPU, CPU and InfiniBand infrastructure, cluster monitoring and node replacement, bare-metal Kubernetes, topology-aware scheduling, and Tensorizer model loading.

## Source excerpt

CoreWeave achieved top MLPerf v5.0 AI inference results, delivering 800 TPS on Llama 3.1 405B with NVIDIA GB200 and 33,000 TPS on Llama 2 70B with H200 GPUs, marking significant performance gains.