Diffusers
Diffusers is an open-source Hugging Face library providing pretrained diffusion models, reusable components, and pipelines for generating or manipulating images, audio, video, and other data.
Local Image Generation
Diffusers is an open-source Python library from Hugging Face that provides pretrained diffusion models and pipelines for generating and manipulating images, audio, and other data.
- How it is used
- Automates Stable Diffusion image generation and repetitive batch workflows from Python notebooks.
- How deep it goes
- Demonstrates pipeline loading, CUDA placement, seeded generation, configuration dictionaries, loops, saving, and checkpoint switching; defers custom-model training.
- Examples
- Uses a sandworm prompt, five graphic-novel panels with ten candidates each, and a Pixel Art Diffusion XL rendering of a poem.
- What you can do after
- Apply it via DiffusionPipeline to generate seeded images, automate saved batches, and swap model checkpoints by changing a path.
Build a Text-to-Image Generator (from Scratch)
Diffusers is an open-source software library providing implementations and pipelines for diffusion models and their image-generation workflows.
- How it is used
- Provides standardized interfaces for importing diffusion models and generating images from text prompts.
- How deep it goes
- Covers installation, pipeline use, U-Net inputs and outputs, and component roles while treating U-Net internals as a black box.
- Examples
- Demonstrates pretrained image generation, prompt batches, output grids, custom resolution, and classifier-free guidance.
- What you can do after
- Apply it via StableDiffusionPipeline to generate prompt-based images and configure precision, resolution, and guidance.
Read how Build a Text-to-Image Generator (from Scratch) explains diffusers →
Deep Learning with JAX
A library of pretrained and trainable diffusion-model pipelines for generating images, audio, video, and other outputs.
- How it is used
- Provides pretrained and trainable diffusion pipelines for generating images, audio, video, molecule structures, and other outputs.
- How deep it goes
- Demonstrates pipeline loading and configuration, while deferring detailed diffusion internals and model-training procedures.
- Examples
- Uses Stable Diffusion v1-5, a TPU backend check, FlaxStableDiffusionPipeline, bfloat16 parameters, and generated image outputs.
- What you can do after
- Apply it via FlaxStableDiffusionPipeline to load a pretrained model and begin generating images with JAX.
Also covered in
What to know first
- diffusion modelA diffusion model is a generative model that learns to reverse a gradual noising process, generating samples through iterative denoising.
- PythonPython is a high-level, general-purpose, dynamically typed programming language with readable syntax and support for multiple programming paradigms.
- Stable DiffusionStable Diffusion is a family of latent diffusion models that generates and edits images from text and other conditioning inputs.
- promptA prompt is text or other input supplied to an AI model to provide instructions, context, or other information that guides its response or generated output.
Related concepts
- Hugging Faceproduced by · Hugging Face is a platform and ecosystem for hosting, discovering, sharing, and using machine-learning models, datasets, applications, and related tools.
- Pythonuses · Python is a high-level, general-purpose, dynamically typed programming language with readable syntax and support for multiple programming paradigms.
- noise scheduleused by · A noise schedule is a prescribed sequence of noise levels or coefficients governing noise addition and removal across diffusion timesteps.
- SDXLuses · SDXL is a Stable Diffusion model variant for generating high-quality images from text prompts and other conditioning inputs, typically at larger resolutions.
- Stable Diffusionused by · Stable Diffusion is a family of latent diffusion models that generates and edits images from text and other conditioning inputs.
Questions about diffusers
What is diffusers?
Diffusers is an open-source Hugging Face library providing pretrained diffusion models, reusable components, and pipelines for generating or manipulating images, audio, video, and other data.
Which Manning books explain diffusers?
Local Image Generation, Build a Text-to-Image Generator (from Scratch) and Deep Learning with JAX.
What should I know before learning diffusers?
Manning books that teach diffusers usually introduce diffusion model, Python, Stable Diffusion and prompt first.
What are the parts of diffusers?
Diffusers includes DiffusionPipeline.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.


