liveBook · Manning

Feature set

As explained in Statistics Every Programmer Needs

A feature subset is a selected collection of predictor variables considered for a model operation such as a tree split.

A feature set is the selected collection of predictor variables supplied to a machine-learning model. In a classification workflow, it is separated from the target variable before training and evaluation. section 6.3.1

A practical feature-set workflow includes:

  • Select relevant predictor columns and assign them to X. section 6.3.1
  • Keep the target labels in y, separate from X. section 6.3.1
  • Split X and y into training and test sets to measure generalization and detect overfitting. section 6.3.1
  • In a random forest, evaluate a random subset of features at each tree split to increase model diversity. section 6.4.1

Football conversion model

A conversion classifier uses QUARTER, TO_GO, OFFENSIVE_TEAM_VENUE, SCORE_DIFFERENTIAL, and PLAY_TYPE as its feature set, while CONVERT supplies the labels.

How Statistics Every Programmer Needs covers it

How deep it goes
Shows column selection, label separation, reproducible splitting, and random feature consideration, but does not derive feature-selection criteria.
Examples
Uses football play variables such as quarter, distance, venue, score differential, and play type.
What it assumes
Assumes familiarity with predictor variables and classification labels while demonstrating their separation from zero in code.
What you can do after
Apply it via scikit-learn by separating X and y, partitioning the data, and fitting tree-based classifiers.
How it connects
Connects predictor variables with target variables, training and test sets, decision trees, and random forests.

Also explained in

Compare how 2 books explain feature set →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Statistics Every Programmer Needs. The section links point to the parts of the book it draws on.