liveBook · Manning

Neural network

As explained in Ensemble Methods for Machine Learning

A neural network is a parameterized computational model composed of connected units that transform inputs through learned weights and nonlinear functions.

A neural network is a parameterized model that uses layers of neurons to transform inputs into increasingly complex feature combinations. Its nonlinearity grows with network depth, along with the number of weights that must be learned. This makes neural networks a flexible alternative to manually searching through combinations of nonlinear functions. section 7.1.5

For nonlinear regression, the model supports a practical workflow:

  • Represent the relationship between inputs and continuous labels through successive neural-network layers. section 7.1.5
  • Increase depth when a more complex nonlinear relationship is needed, while recognizing that additional depth introduces more weights to learn. section 7.1.5
  • Compare predictions with suitable regression measures such as mean squared error and mean absolute deviation. section 7.1.5

Synthetic nonlinear regression

A small data set can be generated from a damped sinusoidal function with added noise, then divided into training and test sets. Scikit-learn's MLPRegressor fits a network with three hidden layers of 50 units. On the reported test set, the neural network obtains MSE 0.043 and MAD 0.164, compared with 0.027 and 0.131 for a depth-five decision tree. section 7.1.5

How Ensemble Methods for Machine Learning covers it

How deep it goes
Explains layers, depth, induced feature combinations, and learned weights, but does not develop neural-network training internals.
Examples
Uses a noisy damped-sinusoid data set, MLPRegressor code, and a decision-tree performance comparison.
What you can do after
Apply it via scikit-learn's MLPRegressor and evaluate predictions with MSE and MAD.
How it connects
Connects nonlinear regression with decision trees, feature combinations, loss functions, and stacking ensembles.

Also explained in

Compare how 4 books explain neural network →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Ensemble Methods for Machine Learning. The section links point to the parts of the book it draws on.