liveBook · Manning

Nonlinear mapping

As explained in Fight Fraud with Machine Learning

Nonlinearity is the property of a function or transformation whose output is not a linear transformation of its input.

A nonlinear mapping produces outputs that are not merely linear transformations of inputs. In deep neural networks, activation functions supply this nonlinearity between weighted layers, allowing the model to learn complex patterns and decision boundaries. section 4.1.1

Nonlinearity matters because it:

  • Prevents stacked neural-network layers from collapsing into one equivalent matrix multiplication. section 4.1.1
  • Increases expressive power by enabling approximation of arbitrary functions and more sophisticated decision boundaries. section 4.1.1
  • Appears through activation functions including Sigmoid, TanH, and ReLU, each offering different computational and gradient behavior. section 4.1.1
Figure 4.5 Some examples of activation functions commonly used in deep neural networks – Sigmoid, TanH, and ReLU.

Compare the shapes and ranges of Sigmoid, TanH, and ReLU, the activation functions used to introduce nonlinearity. section 4.1.1

How Fight Fraud with Machine Learning covers it

How deep it goes
Explains why linear layers collapse, then compares activation functions and their gradient and computation trade-offs.
Examples
Uses Sigmoid, TanH, and ReLU as concrete activation-function examples.
What you can do after
Understand why activation functions are necessary for expressive deep neural networks and how common choices differ.
How it connects
Links activation functions with perceptrons, deep neural networks, gradient descent, loss functions, and optimization algorithms.

Also explained in

Compare how 11 books explain nonlinear mapping →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Fight Fraud with Machine Learning. The section links point to the parts of the book it draws on.