# Supermicro KV Cache Platform With IBM Storage Scale and NVIDIA Dynamo Claims 56x Faster TTFT at 130K Tokens

DevFeed: [Supermicro KV Cache Platform With IBM Storage Scale and NVIDIA Dynamo Claims 56x Faster TTFT at 130K Tokens](<https://devfeed.tech/articles/supermicro-kv-cache-platform-with-ibm-storage-scale-and-nvidia-dynamo-claims-56x-faster-ttft-at-130k-tokens-119575.md>)

Original publisher: [Read original article](<https://www.storagereview.com/news/supermicro-ibm-storage-scale-nvidia-dynamo-kv-cache-platform-56x-ttft>)

Author: Brian Beeler

Published: 2026-11-05T20:45:04Z

Content type: news

Language: en

Sources: [StorageReview.com](<https://devfeed.tech/sources/storagereview-com.md>)

Topics: [Cache](<https://devfeed.tech/topics/cache.md>), [Dynamo](<https://devfeed.tech/topics/dynamo.md>), [NVIDIA Spectrum-X Ethernet](<https://devfeed.tech/topics/nvidia-spectrum-x-ethernet.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amd](<https://devfeed.tech/tags/amd.md>), [amd-epyc](<https://devfeed.tech/tags/amd-epyc.md>), [cache](<https://devfeed.tech/tags/cache.md>), [dynamo](<https://devfeed.tech/tags/dynamo.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [ethernet](<https://devfeed.tech/tags/ethernet.md>), [flash](<https://devfeed.tech/tags/flash.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [ibm](<https://devfeed.tech/tags/ibm.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kv-cache](<https://devfeed.tech/tags/kv-cache.md>), [long-context](<https://devfeed.tech/tags/long-context.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-dynamo](<https://devfeed.tech/tags/nvidia-dynamo.md>), [nvidia-spectrum-x-ethernet](<https://devfeed.tech/tags/nvidia-spectrum-x-ethernet.md>), [scale](<https://devfeed.tech/tags/scale.md>), [servers](<https://devfeed.tech/tags/servers.md>), [storage](<https://devfeed.tech/tags/storage.md>), [supermicro](<https://devfeed.tech/tags/supermicro.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [ttft](<https://devfeed.tech/tags/ttft.md>)

## AI overview

The tested Supermicro, IBM, and NVIDIA KV cache stack reused long-context state from shared flash, cutting time to first token by up to 56x at 130,000 tokens and increasing throughput 22x versus recomputing context. NVIDIA Dynamo manages cache placement and transfers blocks over NIXL; IBM Storage Scale ECE provides the shared tier on eight Supermicro Petascale servers with 983TB raw NVMe capacity and Spectrum-X Ethernet. In a cold-cache test of 200 requests, the tier delivered 4.26 requests per second versus 0.19; under 200GB/s of unrelated network traffic it sustained 3.6 requests per second, about 18x baseline. These results came from one RTX PRO 6000 Blackwell GPU, with host and local cache tiers disabled, and were not independently audited. The tests do not establish performance under a full multi-GPU cluster load; pricing and availability were not announced.

## Source excerpt

Supermicro announced a KV cache storage solution with IBM and NVIDIA today that moves the key-value state behind long-context inference off the GPU and onto a shared all-flash tier. The package combines Supermicro Petascale storage servers on AMD EPYC 9005 processors, IBM Storage Scale, NVIDIA Dynamo, and NVIDIA Spectrum-X Ethernet, and the companies back it The post Supermicro KV Cache Platform With IBM Storage Scale and NVIDIA Dynamo Claims 56x Faster TTFT at 130K Tokens appeared first on StorageReview.com.