liveBook · Manning

Feature selection

As explained in Statistics Every Programmer Needs

Feature selection is the process of choosing a subset of input variables for use in a predictive model.

Feature selection narrows the input variables used by a predictive model. For binary logistic regression, class-wise plots can help identify promising predictors and those that may be less useful. This differs from prioritizing product features under budget and resource constraints. section 5.2.1 section 8.1.3

Use exploratory comparisons to screen candidate predictors:

  • Compare each variable’s distribution across outcome classes; clearer separation may indicate greater predictive potential. section 5.2.1
  • Inspect pairwise correlations between numeric variables to understand their relationships. section 5.2.1

Raisin classification

Class-wise histograms suggest that MajorAxisLength and Perimeter may be useful predictors because their distributions differ between classes; Eccentricity and Extent appear less promising because their distributions are more similar. section 5.2.1

Figure 5.2 A grid of histograms that displays the data distributions of each numeric variable in the raisins data frame, further segmented by the binary variable Class.
figure

Compare the distributions of numeric raisin variables across the two classes. section 5.2.1

How Statistics Every Programmer Needs covers it

How deep it goes
Uses class-wise histograms and correlation heat maps for screening, but specifies no formal selection algorithm.
Examples
Compares raisin predictors, highlighting MajorAxisLength and Perimeter against Eccentricity and Extent.
What you can do after
Evaluate candidate predictors by comparing class-wise distributions and inspecting pairwise correlations.
How it connects
Connects predictor screening to logistic regression and correlation analysis.

Also explained in

Compare how 8 books explain feature selection →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Statistics Every Programmer Needs. The section links point to the parts of the book it draws on.