liveBook · Manning

Min-max normalization

As explained in Math and Architectures of Deep Learning

A preprocessing method that rescales values into a fixed range, here 0–1.

Min-max normalization rescales feature values to a common 0–1 range. Aligning differently sized inputs, such as sales counts and discount percentages, can speed neural-network training and reduce the chance of getting stuck at a local minimum. section 8.5

For each feature column, subtract its minimum and divide by its maximum minus its minimum: X′ = (X − Xmin) / (Xmax − Xmin). The smallest observed value becomes 0 and the largest becomes 1. The PyTorch routine applies the same transformation to the target values.

Demand prediction data

A demand-prediction dataset combines previous-week sales, discount fraction, weeks to the next holidays, and units sold. Sales values are much larger than percentage or count features, making a shared 0–1 scale useful before training the neural network. section 8.5

How Math and Architectures of Deep Learning covers it

How deep it goes
Defines the column-wise formula and shows its PyTorch implementation, stopping short of discussing edge cases or inverse scaling.
Examples
Uses demand prediction with sales, discount, holiday timing, and units-sold data.
What it assumes
Assumes feature and target tensors, while teaching the scaling formula from column minima and maxima.
What you can do after
Apply it via PyTorch by computing column extrema and transforming input and target tensors to 0–1.
How it connects
Connects feature scaling with neural networks, regression, training speed, local minima, and MSE loss.

Also explained in

Compare how 4 books explain min-max normalization →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Math and Architectures of Deep Learning. The section links point to the parts of the book it draws on.