liveBook · Manning

Denoising

As explained in Deep Learning with R, Third Edition

Denoising is the removal of unwanted or corrupting variation from data to recover a cleaner version.

Denoising removes unwanted variation from data to recover a cleaner version. In images, an autoencoder receives a noisy or low-quality input and predicts a cleaned image, often by making informed guesses rather than recovering truly lost detail. section 17.2

A diffusion denoising pipeline follows these main steps:

  • Normalize clean images so their value range matches unit-variance, zero-mean noise. section 17.2.4
  • Sample diffusion times, calculate noise and signal rates, and add random noise to each image. section 17.2.4
  • Predict noise masks, reconstruct denoised images, and train with mean absolute error on the predicted masks. section 17.2.4
  • Repeat denoising from pure noise to generate a new image, extending ordinary denoising into reverse diffusion. section 17.2

Super-resolution can hallucinate detail

A smartphone camera may turn a severely blurred, moon-like printout into a crisp image of lunar craters. The model is generating plausible detail learned from moon photographs, so the result should not be trusted for forensics. section 17.2

Figure 17.7 Reverse diffusion: turning pure noise into an image via repeated denoising
figure

Shows reverse diffusion turning pure noise into an image through repeated denoising. section 17.2

How Deep Learning with R, Third Edition covers it

How deep it goes
Explains the intuition and training sequence, including normalization, schedules, noise injection, reconstruction, and mask loss.
Examples
Uses low-quality JPEGs, smartphone super-resolution, blurred moon images, and pure-noise image generation as examples.
What you can do after
Build it from scratch by implementing a denoising model, diffusion schedule, reconstruction method, and noise-mask loss.
How it connects
Connects autoencoders with super-resolution, diffusion models, image generation, and latent-space methods.

Also explained in

Compare how 7 books explain denoising →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Deep Learning with R, Third Edition. The section links point to the parts of the book it draws on.