liveBook · Manning

Text-to-video generation

Text-to-video generation is the computational creation or modification of video content from textual descriptions or prompts.

How 2 Manning books explain it

Generative AI in Action

Text-to-video generation is the synthesis of video content from textual descriptions.

How it is used
Generates short, realistic or creative video scenes from textual prompts.
How deep it goes
Explains prompt conditioning and iterative denoising, but does not descend into mathematical model internals.
Examples
Uses Sora, Runway Gen-2, Pika, Hotshot, Stable Video Diffusion, and Wochit as video-generation examples.
What you can do after
Apply it via named AI video generators to create clips from descriptions.

Read how Generative AI in Action explains text-to-video generation →

Introduction to Generative AI, Second Edition

A text-to-video system generates or modifies video content from textual prompts.

How it is used
Supports filmmaking by generating storyboards, environments, simulated scenes, visual effects, and other production assets from prompts.
How deep it goes
Explains the capability and practical uses through overview examples, but stops short of model architecture or implementation details.
Examples
Uses Sora’s coral-reef video and filmmaking workflows involving storyboards, environments, simulated scenes, and post-production.
What you can do after
Evaluate text-to-video uses, limitations, and ethical consequences in filmmaking and synthetic media.

Read how Introduction to Generative AI, Second Edition explains text-to-video generation →

Related concepts

Questions about text-to-video generation

What is text-to-video generation?

Text-to-video generation is the computational creation or modification of video content from textual descriptions or prompts.

Which Manning books explain text-to-video generation?

Generative AI in Action and Introduction to Generative AI, Second Edition.

What is the difference between text-to-video generation and text-to-image model?

Text-to-video generation is the computational creation or modification of video content from textual descriptions or prompts. A text-to-image model is a generative machine-learning model that produces images conditioned on textual descriptions or prompts.

What kinds of text-to-video generation are there?

Kinds of text-to-video generation include Sora and RunwayML.

What is text-to-video generation a kind of?

Text-to-video generation is a kind of generation. Generation is the production of an output by a computational model from supplied input or context, often using patterns learned from data.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.