liveBook · Manning

Supervised learning

As explained in Statistics Every Programmer Needs

Supervised learning is a machine-learning approach that learns a mapping from inputs to known target outcomes using labeled examples.

Supervised learning learns a relationship between labeled inputs and known outcomes, then applies that relationship to predict outcomes for new, unseen data. section 4.0

Choose the supervised-learning method according to the target and the relationship being modeled:

  • Use linear regression when the response is numeric and the relationship between predictors and outcome is approximately linear. section 4.0 section 4.1
  • Use classification methods when the outcome is categorical, such as a label or group membership; do not use linear regression for this task. section 4.1
  • Evaluate predictions with held-out data; decision trees and random forests use test sets, accuracy, and confusion matrices to assess generalization. section 6.5

Prediction and decision support

Applications include predicting sales from advertising expenditure, home prices from property characteristics, student performance from academic measures, and product demand from historical sales. section 4.0

How Statistics Every Programmer Needs covers it

How deep it goes
Defines the learning setup and links it to regression, classification, and evaluation, but does not develop a general algorithm.
Examples
Uses sales, home prices, student performance, product demand, decision trees, and random forests as prediction examples.
What it assumes
Assumes labeled inputs and known outcomes, while distinguishing numeric responses from categorical outcomes.
What you can do after
Apply it via regression, decision trees, or random forests to predict outcomes and evaluate generalization on test data.
How it connects
Connects supervised learning to linear regression, classification, decision trees, random forests, accuracy, and confusion matrices.

Also explained in

Compare how 19 books explain supervised learning →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Statistics Every Programmer Needs. The section links point to the parts of the book it draws on.