liveBook · Manning

Video generation

As explained in Introduction to Generative AI, Second Edition

Generative video is the synthesis or transformation of video content using generative machine-learning models.

Video generation uses generative machine-learning models to create or transform moving images. Tools such as Runway and Sora make video generation and editing faster, more accessible, and increasingly controllable for artists and filmmakers. section 1.21 section 4.7

Common creative roles include:

  • Automating time-intensive production tasks so artists can focus on story, composition, and stylistic experimentation. section 4.7
  • Turning previously impractical visual ideas into sequences, animations, and immersive experiences. section 4.7 section 4.9
  • Supporting AI-assisted filmmaking through partnerships between video technology companies and major studios. section 1.21

The Hardest Part

Washed Out’s 2024 music video, directed by Paul Trillo, stitched dozens of Sora-generated clips into a continuous dreamlike zoom from text prompts. The process enabled a concept Trillo had imagined years earlier but previously lacked the tools to produce. section 4.9

The technology also complicates ideas of originality, authorship, and recognized creative labor. Its growing accessibility changes who can produce video, but does not settle how generated work should be valued or governed. section 4.7

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Explains capabilities, creative uses, and societal questions at overview level without implementation details.
Examples
Uses Runway, Sora, AI-generated animation, and Washed Out’s Sora-produced music video as concrete examples.
What you can do after
Apply it via Runway or Sora to generate or edit video and evaluate related authorship and labor questions.
How it connects
Connects video generation to generative AI, machine learning, animation, filmmaking, visual art, and intellectual property.

Also explained in

Compare how 2 books explain video generation →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.