Manifold
A manifold is a mathematical space that locally resembles Euclidean space, although its global geometry or topology may be more complex.
Deep Learning with Python, Third Edition
A lower-dimensional geometric subspace that is locally similar to Euclidean space, used here to describe the structure of valid data samples.
- How it is used
- Explains why structured input data lets deep networks generalize by interpolating between nearby training samples.
- How deep it goes
- Defines a manifold intuitively and works through handwritten-digit paths and interpolation, without a formal geometric derivation.
- Examples
- Uses handwritten digits, crumpled colored sheets, and clock-hand features to illustrate data structure and simpler representations.
- What you can do after
- Evaluate/understand why nearby inputs may generalize while unfamiliar variations require better training coverage.
Read how Deep Learning with Python, Third Edition explains manifold →
Deep Learning with R, Third Edition
A manifold is a continuous surface or space that locally resembles a simpler coordinate space and can represent the structure of data.
- How it is used
- Uses manifolds to explain class disentanglement and why models can generalize to nearby unseen inputs.
- How deep it goes
- Defines a lower-dimensional, locally linear subspace and develops visual intuitions, without a formal geometric derivation.
- Examples
- Illustrates the idea with crumpled colored paper, morphing MNIST digits, latent interpolation, and a shuffled-label training example.
- What you can do after
- Evaluate/understand why interpolation across learned data structure can support generalization while memorizing arbitrary labels cannot explain it.
Read how Deep Learning with R, Third Edition explains manifold →
Math and Architectures of Deep Learning
A one-dimensional manifold.
- How it is used
- Frames neural-network computation as transforming an input manifold into a representation suited to classification.
- How deep it goes
- Defines local Euclidean structure, boundaries, second countability, and homeomorphism, but stops short of rigorous manifold theory.
- Examples
- Uses circles, spheres, disks, cylinders, 8-curves, hourglasses, and smooth versus zigzag latent curves.
- What you can do after
- Evaluate/understand why geometric transformations can make classification linearly separable.
Read how Math and Architectures of Deep Learning explains manifold →
Related concepts
- latent spaceused by · A latent space is a learned representational space in which numerical coordinates encode information or features inferred from observed data.
- interpolationused by · Interpolation is the estimation or construction of values or representations between known points according to an assumed relationship or specified rule.
- text encoderproduced by · A text encoder is a neural-network model that transforms textual input into numerical representations for conditioning or other downstream computation.
- surfaceincludes · A surface is a two-dimensional geometric set, often embedded in three-dimensional space or representing a boundary or relation.
- UMAPused by · UMAP, or Uniform Manifold Approximation and Projection, is a nonlinear manifold-learning technique that embeds high-dimensional data in a lower-dimensional space while preserving important neighborhood and structural relationships.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.