Cosine noise schedule

As explained in Build a Text-to-Image Generator (from Scratch)

A cosine diffusion schedule is a noise schedule whose clean-image and noise weights vary over time according to a cosine-based function.

How Build a Text-to-Image Generator (from Scratch) covers it

How deep it goes

Explains cosine weights, contrasts their curves with linear weights, and implements noisy-image generation without detailing denoiser internals.

Examples

Uses plotted weight curves and successive noisy versions of a bunny image across seven timesteps.

What it assumes

Assumes familiarity with clean images, random noise, timesteps, and forward diffusion while introducing schedule behavior through code and plots.

What you can do after

Build it from scratch by computing cosine weights, plotting schedule behavior, and generating progressively noisy images.

How it connects

Connects forward diffusion with linear noise schedules, reverse diffusion, denoising, and U-Nets.

liveBookmanning.com

Read Build a Text-to-Image Generator (from Scratch) on liveBook Get the book at manning.com

Related concepts

• noise schedulekind of · A noise schedule is a prescribed sequence of noise levels or coefficients governing noise addition and removal across diffusion timesteps.
• linear noise schedulecontrasts with · A linear noise schedule is a noise schedule in which the noise parameter changes linearly across diffusion timesteps.
• cosine annealingcontrasts with · Cosine annealing is a learning-rate scheduling method that varies the learning rate over training according to a cosine-shaped curve.
• learning rate schedulecontrasts with · A learning rate schedule is a rule or function that determines how an optimizer’s learning rate changes during training.
• cosine functionuses · The cosine function is a periodic trigonometric function that maps a real number or angle to a value between −1 and 1.

This explainer was generated by Manning's knowledge graph from the text of Build a Text-to-Image Generator (from Scratch). The section links point to the parts of the book it draws on.