Skip to content

docs: use "audio" instead of "sound" in README and model reference #372

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
yaoxu-crypto wants to merge 2 commits into from
Closed

docs: use "audio" instead of "sound" in README and model reference #372

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
9460ff3
docs(models): use "audio" instead of "sound" in model reference
yaoxu-crypto Oct 7, 2026
f976e4e
docs(readme): use "audio" instead of "sound"
yaoxu-crypto Oct 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ One model, two surfaces:
| | Inputs | Outputs | Use it for |
|---|---|---|---|
| **Reasoner** | text, vision | text | world understanding, grounding, task planning, embodied reasoning |
| **Generator** | text, vision, sound, action | vision, sound, action | world simulation, future prediction, synthetic data, policy learning |
| **Generator** | text, vision, audio, action | vision, audio, action | world simulation, future prediction, synthetic data, policy learning |

This repository is the home of the models: everything for exploring, running, and evaluating Cosmos. For model training (SFT, LoRA, RL, distillation etc.), go to [Cosmos Framework](https://github.com/NVIDIA/cosmos-framework). Use [Cosmos Curator](https://github.com/NVIDIA/cosmos-curator) for data curation, and [Cosmos Evaluator](https://github.com/NVIDIA/cosmos-evaluator) for model output evaluation.

Expand Down Expand Up @@ -114,7 +114,7 @@ video = pipe(prompt="A mobile robot navigates a warehouse aisle and stops at a s
export_to_video(video, "first_video.mp4", fps=24)
```

First run downloads the 16B checkpoint; diffusion steps are compute-heavy, so long step times are normal. Full options, image/sound modes, and every other backend: [audiovisual cookbooks](cookbooks/cosmos3/generator/audiovisual/) · setup issues: [environment setup guide](cookbooks/cosmos3/README.md).
First run downloads the 16B checkpoint; diffusion steps are compute-heavy, so long step times are normal. Full options, image/audio modes, and every other backend: [audiovisual cookbooks](cookbooks/cosmos3/generator/audiovisual/) · setup issues: [environment setup guide](cookbooks/cosmos3/README.md).


## Models
Expand Down
6 changes: 3 additions & 3 deletions docs/reference/models.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,9 +41,9 @@ Cosmos 3 is built on a unified Mixture-of-Transformers (MoT) architecture combin
</thead>
<tbody>
<tr><td align="center">t2v</td><td align="center">Text</td><td align="center">Video<br>(256p, 480p, 720p)</td><td align="center">Video<br>(256p, 480p, 720p)</td><td align="center">Video<br>(256p, 480p)</td></tr>
<tr><td align="center">t2sv</td><td align="center">Text</td><td align="center">Video with sound<br>(256p, 480p, 720p)</td><td align="center">Video with sound<br>(256p, 480p, 720p)</td><td align="center">Not supported</td></tr>
<tr><td align="center">t2av</td><td align="center">Text</td><td align="center">Video with audio<br>(256p, 480p, 720p)</td><td align="center">Video with audio<br>(256p, 480p, 720p)</td><td align="center">Not supported</td></tr>
<tr><td align="center">i2v — 1st frame</td><td align="center">Text + image<br>(JPG/PNG/JPEG/WEBP)</td><td align="center">Video<br>(256p, 480p, 720p)</td><td align="center">Video<br>(256p, 480p, 720p)</td><td align="center">Video<br>(256p, 480p)</td></tr>
<tr><td align="center">i2sv</td><td align="center">Text + image<br>(JPG/PNG/JPEG/WEBP)</td><td align="center">Video with sound<br>(256p, 480p, 720p)</td><td align="center">Video with sound<br>(256p, 480p, 720p)</td><td align="center">Not supported</td></tr>
<tr><td align="center">i2av</td><td align="center">Text + image<br>(JPG/PNG/JPEG/WEBP)</td><td align="center">Video with audio<br>(256p, 480p, 720p)</td><td align="center">Video with audio<br>(256p, 480p, 720p)</td><td align="center">Not supported</td></tr>
<tr><td align="center">v2v — transfer</td><td align="center">Text + MP4 video<br>(edge, blur, depth, segmentation map)</td><td align="center">Video<br>(256p, 480p, 720p)</td><td align="center">Video<br>(256p, 480p, 720p)</td><td align="center">Not supported</td></tr>
<tr><td align="center">v2v — predict</td><td align="center">Text + MP4 video<br>(first 5 frames used, up to ~3 s of conditioning)</td><td align="center">Video<br>(256p, 480p, 720p)</td><td align="center">Video<br>(256p, 480p, 720p)</td><td align="center">Not supported</td></tr>
<tr><td align="center">t2i</td><td align="center">Text string</td><td align="center">Image<br>(256p, 480p, 720p)</td><td align="center">Image<br>(256p, 480p, 720p)</td><td align="center">Not supported</td></tr>
Expand Down Expand Up @@ -91,4 +91,4 @@ Every workflow has a runnable notebook — see [cookbooks](../../cookbooks/cosmo

## Limitations

Cosmos 3 can produce artifacts in long, high-resolution, or physically complex outputs: temporal inconsistency, unstable camera/object motion, sound-video misalignment, action-state inconsistency, object morphing, inaccurate 3D structure, implausible dynamics. Physically grounded simulation, safety-critical control, and complex multi-agent behavior require additional validation, guardrails, and system-level safety analysis before deployment.
Cosmos 3 can produce artifacts in long, high-resolution, or physically complex outputs: temporal inconsistency, unstable camera/object motion, audio-video misalignment, action-state inconsistency, object morphing, inaccurate 3D structure, implausible dynamics. Physically grounded simulation, safety-critical control, and complex multi-agent behavior require additional validation, guardrails, and system-level safety analysis before deployment.
Loading