# Start and Restore GPU Workloads in Seconds with NVIDIA Snapshot

DevFeed: [Start and Restore GPU Workloads in Seconds with NVIDIA Snapshot](<https://devfeed.tech/articles/start-and-restore-gpu-workloads-in-seconds-with-nvidia-snapshot-127100.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/start-and-restore-gpu-workloads-in-seconds-with-nvidia-snapshot/>)

Author: Ron Kahn

Published: 2026-11-10T15:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [TensorRT-LLM](<https://devfeed.tech/topics/tensorrt-llm.md>), [TensorRT](<https://devfeed.tech/topics/tensorrt.md>), [NVIDIA DSX](<https://devfeed.tech/topics/nvidia-dsx.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [ai-platforms-deployment](<https://devfeed.tech/tags/ai-platforms-deployment.md>), [checkpoint](<https://devfeed.tech/tags/checkpoint.md>), [cloud-services](<https://devfeed.tech/tags/cloud-services.md>), [component](<https://devfeed.tech/tags/component.md>), [data-center-cloud](<https://devfeed.tech/tags/data-center-cloud.md>), [dsx](<https://devfeed.tech/tags/dsx.md>), [dsx-ai-factory-platform](<https://devfeed.tech/tags/dsx-ai-factory-platform.md>), [featured](<https://devfeed.tech/tags/featured.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kubecon](<https://devfeed.tech/tags/kubecon.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [platform](<https://devfeed.tech/tags/platform.md>), [restore](<https://devfeed.tech/tags/restore.md>), [snapshot](<https://devfeed.tech/tags/snapshot.md>)

## AI overview

NVIDIA Snapshot checkpoints an initialized GPU workload's CPU and GPU memory, then restores it as a Kubernetes Pod on a node with the same GPU model and driver. This skips weight loading, compilation, and graph capture; infrastructure provisioning and container image loading remain outside the reported restore time. Across the tested vLLM, SGLang, and TensorRT LLM configurations on B200 GPUs, restores took 3.6-42.7 seconds, 8-36 times faster than cold starts. Checkpoint creation took 15 seconds to 5.5 minutes, but checkpoint plus restore was faster than one cold start in every tested configuration. Large eight-GPU MoE restores took under 43 seconds, with GPU state transfer the largest restore stage. Workloads need to meet Snapshot's compatibility requirements and provide a small pause/resume handshake. Excerpts identify ready-made examples and multi-GPU support but do not give the full requirements.

## Source excerpt

NVIDIA Snapshot, a new open-source component of the NVIDIA DSX AI Factory Platform, makes initialized GPU workloads reusable across inference...