liveBook · Manning

Stable Diffusion

Stable Diffusion is a family of latent diffusion models that generates and edits images from text and other conditioning inputs.

How 4 Manning books explain it

Local Image Generation

Stable Diffusion 1.5 is a version of the Stable Diffusion family of latent diffusion models for image generation.

How it is used
Generates images from text, then supports iterative prompting, reproducible experiments, automation, and customization.
How deep it goes
Explains the full generation path through VAE, CLIP encoding, denoising, and scheduling, while deferring component nuts and bolts.
Examples
Uses coffee prompts, repeated seeded generation, a Python Diffusers pipeline, flawed human portraits, and a fine-tuned giant grasshopper.
What you can do after
Apply it via AUTOMATIC1111 or Hugging Face Diffusers to generate repeatable images and automate customized workflows.

Read how Local Image Generation explains Stable Diffusion →

Build a Text-to-Image Generator (from Scratch)

Stable Diffusion is a latent diffusion model for generating and editing images from text and other conditioning inputs.

How it is used
Generates and edits images from text and other conditioning inputs through accessible latent-diffusion tooling.
How deep it goes
Explains the three-component architecture, tensor shapes, reverse diffusion, inference steps, and practical pipeline parameters.
Examples
Uses prompts about astronauts, unicorns, animals, beaches, lions, and tigers to demonstrate generation and embedding interpolation.
What you can do after
Apply it via Hugging Face Diffusers to generate images, vary inference settings, and blend text embeddings into hybrid outputs.

Read how Build a Text-to-Image Generator (from Scratch) explains Stable Diffusion →

Generative AI in Action

Stable Diffusion is a family of diffusion-based generative models that produces images from textual and other conditioning inputs.

How it is used
Supports enterprise image generation and editing across architecture, fashion, e-commerce, entertainment, and healthcare applications.
How deep it goes
Explains the text encoder, UNet, scheduler, and VAE, then demonstrates API parameters without deriving the underlying mathematics.
Examples
Demonstrates a laughing panda prompt, an SDXL REST request, API header and body parameters, and the resulting generated image.
What you can do after
Apply it via a Stability REST API using an engine ID, bearer authentication, prompts, dimensions, weights, and generation controls.

Read how Generative AI in Action explains Stable Diffusion →

Deep Learning with JAX

A widely used pretrained text-to-image diffusion model.

How it is used
Generates images from text prompts through a pretrained diffusion pipeline.
How deep it goes
Explains text encoding and multistep diffusion, but defers the model’s internal mathematics.
Examples
Uses the runwayml/stable-diffusion-v1-5 checkpoint, a Flax pipeline, bfloat16 parameters, TPU execution, and eight generated images.
What you can do after
Apply it via Diffusers to generate images and assemble custom diffusion pipelines.

Read how Deep Learning with JAX explains Stable Diffusion →

Also covered in

What to know first

Related concepts

Questions about Stable Diffusion

What is Stable Diffusion?

Stable Diffusion is a family of latent diffusion models that generates and edits images from text and other conditioning inputs.

Which Manning books explain Stable Diffusion?

Local Image Generation, Build a Text-to-Image Generator (from Scratch), Generative AI in Action and Deep Learning with JAX.

What should I know before learning Stable Diffusion?

Manning books that teach Stable Diffusion usually introduce prompt, digital image, image generation and diffusion model first.

What is the difference between Stable Diffusion and DALL-E?

Stable Diffusion is a family of latent diffusion models that generates and edits images from text and other conditioning inputs. DALL·E is a family of OpenAI generative models that creates images from natural-language descriptions and other conditioning inputs.

What is Stable Diffusion a kind of?

Stable Diffusion is a kind of image generation model. An image generation model is a machine-learning model that creates, edits, or transforms images from learned patterns and conditioning inputs.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.