ai-trend-notifierKO
← wiki

$ cat wiki/models/cosmos-h-dreams.md

Cosmos-H-Dreams

Spec

AttributeValue
DeveloperNVIDIA
Released2026-07-22
Announced2026-07-22
Context windowunknown
Pricingopen-source (Apache 2.0)
LicenseApache 2.0
AvailabilityHuggingFace (nvidia/Cosmos-H-Surgical-Simulator)

Overview

Cosmos-H-Dreams is an action-conditioned world foundation model for surgical robotics simulation. It generates photorealistic surgical scene video from robot commands, enabling sim-to-real transfer for surgical robot policy training without physical hardware.

Part of NVIDIA's Medical Physics Simulation open-source framework, which pairs Cosmos-H-Dreams with classical physics simulators (NVIDIA Warp/Newton engines).

Use Cases

  • Surgical robot training: generate diverse policy rollouts at 600 rollouts/40 minutes (vs. 2 days physical benchtop)
  • Digital twins: CMR Surgical, Johnson & Johnson MedTech, Medtronic building on this platform
  • Soft-tissue dynamics: deformation, blood, smoke, fluoroscopy imagery

Compared To

ModelDeveloperDomainNotes
Cosmos 3 SuperNVIDIAGeneral physical AI64B omnimodal MoT, broader scope
Gemini Robotics ER 1.6Google DeepMindPhysical AISpatial reasoning, instrument-panel
Cosmos-H-DreamsNVIDIASurgical roboticsDomain-specialized, world model

Referenced by

Sources