liveBook · Manning

Diffusers

Diffusers is an open-source Hugging Face library providing pretrained diffusion models, reusable components, and pipelines for generating or manipulating images, audio, video, and other data.

How 3 Manning books explain it

Local Image Generation

Diffusers is an open-source Python library from Hugging Face that provides pretrained diffusion models and pipelines for generating and manipulating images, audio, and other data.

How it is used
Automates Stable Diffusion image generation and repetitive batch workflows from Python notebooks.
How deep it goes
Demonstrates pipeline loading, CUDA placement, seeded generation, configuration dictionaries, loops, saving, and checkpoint switching; defers custom-model training.
Examples
Uses a sandworm prompt, five graphic-novel panels with ten candidates each, and a Pixel Art Diffusion XL rendering of a poem.
What you can do after
Apply it via DiffusionPipeline to generate seeded images, automate saved batches, and swap model checkpoints by changing a path.

Read how Local Image Generation explains diffusers →

Build a Text-to-Image Generator (from Scratch)

Diffusers is an open-source software library providing implementations and pipelines for diffusion models and their image-generation workflows.

How it is used
Provides standardized interfaces for importing diffusion models and generating images from text prompts.
How deep it goes
Covers installation, pipeline use, U-Net inputs and outputs, and component roles while treating U-Net internals as a black box.
Examples
Demonstrates pretrained image generation, prompt batches, output grids, custom resolution, and classifier-free guidance.
What you can do after
Apply it via StableDiffusionPipeline to generate prompt-based images and configure precision, resolution, and guidance.

Read how Build a Text-to-Image Generator (from Scratch) explains diffusers →

Deep Learning with JAX

A library of pretrained and trainable diffusion-model pipelines for generating images, audio, video, and other outputs.

How it is used
Provides pretrained and trainable diffusion pipelines for generating images, audio, video, molecule structures, and other outputs.
How deep it goes
Demonstrates pipeline loading and configuration, while deferring detailed diffusion internals and model-training procedures.
Examples
Uses Stable Diffusion v1-5, a TPU backend check, FlaxStableDiffusionPipeline, bfloat16 parameters, and generated image outputs.
What you can do after
Apply it via FlaxStableDiffusionPipeline to load a pretrained model and begin generating images with JAX.

Read how Deep Learning with JAX explains diffusers →

Also covered in

What to know first

Related concepts

Questions about diffusers

What is diffusers?

Diffusers is an open-source Hugging Face library providing pretrained diffusion models, reusable components, and pipelines for generating or manipulating images, audio, video, and other data.

Which Manning books explain diffusers?

Local Image Generation, Build a Text-to-Image Generator (from Scratch) and Deep Learning with JAX.

What should I know before learning diffusers?

Manning books that teach diffusers usually introduce diffusion model, Python, Stable Diffusion and prompt first.

What are the parts of diffusers?

Diffusers includes DiffusionPipeline.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.