# NVIDIA Cosmos-H-Dreams: Bringing Real-Time Generative Simulation to Surgical Robotics

DevFeed: [NVIDIA Cosmos-H-Dreams: Bringing Real-Time Generative Simulation to Surgical Robotics](<https://devfeed.tech/articles/nvidia-cosmos-h-dreams-bringing-real-time-generative-simulation-to-surgical-robotics-7378.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/nvidia/cosmos-h-dreams>)

Author: Lukas Zbinden; Javier Gamazo; Mostafa Toloui; Sean Huver

Published: 2026-07-27T09:32:20Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Cosmos](<https://devfeed.tech/topics/cosmos.md>), [Robotics](<https://devfeed.tech/topics/robotics.md>), [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [real-time](<https://devfeed.tech/topics/real-time.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Synthetic Data Generation](<https://devfeed.tech/topics/synthetic-data-generation.md>), [synthetic-data](<https://devfeed.tech/topics/synthetic-data.md>), [data](<https://devfeed.tech/topics/data.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [cosmos](<https://devfeed.tech/tags/cosmos.md>), [data](<https://devfeed.tech/tags/data.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [generation](<https://devfeed.tech/tags/generation.md>), [generative](<https://devfeed.tech/tags/generative.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [streaming](<https://devfeed.tech/tags/streaming.md>), [synthetic-data](<https://devfeed.tech/tags/synthetic-data.md>), [synthetic-data-generation](<https://devfeed.tech/tags/synthetic-data-generation.md>), [training](<https://devfeed.tech/tags/training.md>)

## AI overview

NVIDIA introduces Cosmos-H-Dreams, a real-time, action-conditioned generative simulator for surgical robotics. The model generates future surgical video from an initial RGB frame and live robot kinematics, enabling interactive closed-loop control, offline policy evaluation, and synthetic data generation.

## Source excerpt

World foundation models offer a different path. Instead of manually authoring every object and physical interaction, they learn visual dynamics directly from synchronized video and robot kinematics. NVIDIA's Cosmos-H-Surgical-Simulator demonstrated this approach by generating future surgical video from an initial scene and a sequence of robot actions. It enabled faster-than-physical evaluation and synthetic data generation across the Open-H-Embodiment ecosystem.