Text To Video

How Sora-Style Models Turn a Text Prompt Into Coherent Video

Modern text-to-video models like OpenAI's Sora generate video by first compressing it into "spacetime patches." A transformer then iteratively denoises these patches, guided by the text prompt, to produce coherent and temporally consistent clips.