Autoencoder
An autoencoder is a neural network that encodes input data into an internal representation and decodes it to reconstruct the input or an approximation.
Inside Deep Learning: Math, Algorithms, Models
A neural network trained to reconstruct its input, typically by compressing it into a lower-dimensional latent representation and decoding it back.
- How it is used
- Trains representations without labels for dimensionality reduction, reconstruction, robustness testing, and outlier detection.
- How deep it goes
- Explains latent representations, bottlenecks, noise constraints, PCA connections, and PyTorch implementations, but defers sequence cases to autoregressive models.
- Examples
- Uses MNIST digit reconstructions, two-dimensional latent plots, PCA implementations, Gaussian noise, dropout noise, and reconstruction-error thresholds.
- What you can do after
- Builds fully connected PyTorch autoencoders, trains them with MSE, inspects reconstructions, and evaluates robustness or outliers.
Read how Inside Deep Learning: Math, Algorithms, Models explains autoencoder →
Outlier Detection in Python
An autoencoder is a neural network trained to encode an input into a representation and reconstruct the original input.
- How it is used
- Uses reconstruction error to estimate outlierness in tabular and image data.
- How deep it goes
- Explains encoder, bottleneck, decoder, and reconstruction, then demonstrates library detectors rather than deriving their training algorithms.
- Examples
- Demonstrates a PyOD detector on encoded KDD Cup records and an alibi-detect detector on clean and noise-perturbed CIFAR10 images.
- What you can do after
- Apply it via PyOD or alibi-detect to score candidate outliers and inspect image reconstructions.
Math and Architectures of Deep Learning
A neural network model trained to compress inputs into a latent representation and reconstruct the original inputs from that representation.
- How it is used
- Learns compact input representations by reconstructing inputs without human-provided labels.
- How deep it goes
- Develops encoder-decoder training, reconstruction losses, convolutional implementations, and nonlinear comparison with PCA; defers autoencoder training details during transpose-convolution discussion.
- Examples
- Uses 32 × 32 image encoders and decoders, normalized image reconstruction, transpose-convolution upsampling, and MNIST reconstruction comparisons.
- What you can do after
- Build an image autoencoder in PyTorch with convolutional encoding, transposed-convolution decoding, and reconstruction loss.
Read how Math and Architectures of Deep Learning explains autoencoder →
Data Without Labels
An autoencoder is a neural-network model that learns to encode data into a lower-dimensional representation and reconstruct the original input from it.
- How it is used
- Uses autoencoders for unsupervised feature learning, dimensionality reduction, reconstruction-based anomaly detection, and denoising.
- How deep it goes
- Explains encoder–bottleneck–decoder training choices and implements a basic model, while leaving the mathematics of variants to further reading.
- Examples
- Builds a Keras autoencoder for MNIST digits and plots test images beside their reconstructions.
- What you can do after
- Apply it via Keras to train a basic digit autoencoder and inspect reconstructions on test data.
Evolutionary Deep Learning: Genetic algorithms and neural networks
An autoencoder is a neural network that learns to encode inputs into a representation and decode that representation to reconstruct the inputs.
- How it is used
- Uses reconstruction without labels to learn feature encodings for images and to optimize AE architectures evolutionarily.
- How deep it goes
- Works through a convolutional Keras build, training, genetic encoding, mutation, crossover, and validation-loss evaluation; variational AEs are only summarized.
- Examples
- Uses Fashion-MNIST training images, MNIST latent-space visualization with t-SNE, and evolved convolutional architectures.
- What you can do after
- Build it from scratch as a convolutional Keras autoencoder and evolve balanced encoder-decoder architectures with DEAP.
Read how Evolutionary Deep Learning: Genetic algorithms and neural networks explains autoencoder →
Learn Generative AI with PyTorch
A neural network that learns to compress inputs into a latent representation and reconstruct them, used here for digit-image generation and reconstruction.
- How it is used
- Uses compressed representations to reconstruct handwritten digits and establish a starting point for variational autoencoders.
- How deep it goes
- Works through dense-layer architecture, data preparation, squared-error training, and visual checks; defers validation-based parameter tuning.
- Examples
- Builds a dense-layer MNIST autoencoder and plots ten original digits beside their reconstructions.
- What you can do after
- Build it from scratch in PyTorch to encode handwritten digits, reconstruct them, and visually compare outputs with originals.
Read how Learn Generative AI with PyTorch explains autoencoder →
Graph Neural Networks in Action
An autoencoder is a neural network that encodes inputs into latent representations and decodes those representations to reconstruct the inputs.
- How it is used
- Uses reconstruction to learn compact representations and, for graphs, predict missing links.
- How deep it goes
- Explains the encoder–latent space–decoder pipeline and outlines graph training steps without deriving the loss mathematically.
- Examples
- Illustrates image reconstruction and graph link prediction on the Amazon Products dataset.
- What you can do after
- Build it from scratch as a graph autoencoder by defining components, preparing graph data, training with edge data, and testing predictions.
Read how Graph Neural Networks in Action explains autoencoder →
Delivering Machine Learning Projects: From design to deployment
An autoencoder is a neural network that learns to encode inputs into a lower-dimensional representation and reconstruct the original inputs.
- How it is used
- Uses reconstruction error to detect anomalous news articles during regional feature development.
- How deep it goes
- Explains the operational use of reconstruction errors but does not detail architecture, training procedure, or tuning.
- Examples
- Uses historical regional news articles and per-article reconstruction errors as the concrete detection example.
- What you can do after
- Evaluate anomalous articles by measuring their reconstruction errors against a learned regional baseline.
Read how Delivering Machine Learning Projects: From design to deployment explains autoencoder →
Financial AI in Practice
An autoencoder is a neural network trained to reconstruct its input, typically by encoding it into a lower-dimensional representation and decoding it.
- How it is used
- Flags transactions that depart from learned legitimate behavior as candidates for novel-fraud review.
- How deep it goes
- Works through data filtering, architecture, training, error-based evaluation, and threshold considerations; it does not supply a universal alert threshold.
- Examples
- Uses scaled credit-card transactions, a Keras encoder–decoder, legitimate-only training, and a mixed legitimate-and-fraudulent test set.
- What you can do after
- Build it from scratch with Keras to score transaction anomalies, then evaluate errors and choose a review threshold with operational feedback.
Deep Learning with R, Third Edition
An autoencoder is a neural-network model that learns to encode inputs into representations and decode those representations back into approximations of the inputs.
- How it is used
- Compresses inputs into latent representations and reconstructs them, with denoising as its strongest practical application.
- How deep it goes
- Explains encoder–decoder reconstruction, latent constraints, denoising, and probabilistic extensions without deriving their mathematics.
- Examples
- Uses image reconstruction, low-quality JPEG denoising, smartphone super-resolution, and repeated denoising from pure noise.
- What you can do after
- Evaluate/understand how encoder–decoder models reconstruct images and why denoising and super-resolution can invent plausible detail.
Read how Deep Learning with R, Third Edition explains autoencoder →
Deep Learning with Python, Third Edition
A neural network trained to reconstruct its input, often by compressing and then decoding it, used here for denoising images.
- How it is used
- Uses reconstruction to learn image representations, denoise degraded inputs, and support latent-space image generation.
- How deep it goes
- Explains encoder-decoder reconstruction, sparse codes, variational extensions, and iterative denoising without detailing implementation.
- Examples
- Uses reconstructed images, noisy JPEGs, low-resolution photographs, hallucinated moon craters, and pure-noise-to-image generation.
- What you can do after
- Evaluate/understand when reconstruction, denoising, latent representations, or diffusion-based generation fit an image task.
Read how Deep Learning with Python, Third Edition explains autoencoder →
Introduction to Generative AI, Second Edition
An autoencoder is a neural network that learns to encode data into a compressed representation and reconstruct the original data from it.
- How it is used
- Explains image and video creation or alteration within synthetic media, especially deepfake face-swapping.
- How deep it goes
- Defines encoding, latent representations, and reconstruction, then sketches face-swapping; it stops short of implementation details.
- Examples
- Uses facial expressions, face angles, skin tones, and a single-encoder, two-decoder face swap.
- What you can do after
- Evaluate/understand how compression and reconstruction support face-swapping and why synthetic-media trust is difficult.
Read how Introduction to Generative AI, Second Edition explains autoencoder →
Related concepts
- encoderhas part · An encoder is a component that transforms input data into an encoded representation for subsequent processing, reconstruction, comparison, or transmission.
- decoderhas part · A decoder is a component that maps encoded data or representations to decoded values, reconstructed data, or generated output.
- variational autoencoderincludes · A variational autoencoder is a generative neural network that learns a probabilistic latent representation of data and decodes samples from it to reconstruct or generate data.
- deep learningkind of · Deep learning is a machine-learning approach that uses neural networks with multiple computational layers to learn representations from data.
- neural networkkind of · A neural network is a computational model of interconnected, parameterized units that learns transformations from inputs to outputs.
- Kerasuses · Keras is an open-source, high-level deep-learning API for building, training, evaluating, and deploying neural-network models.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.