Importance score
An importance score is a numerical value indicating an item's relative significance, relevance, or contribution within a specified context.
Machine Learning System Design
A quantitative attribution describing how much an input feature contributes to a model's output or predictive performance.
- How it is used
- Guides feature selection, prediction explanations, and verification of newly trained models before deployment.
- How deep it goes
- Surveys model-specific, model-agnostic, and deep-learning techniques with practical selection examples; stops short of a universal deep-learning explanation method.
- Examples
- Uses taxi-price explanations, retail-demand features, and search-ranking complaints to show distinct reasons for examining contributions.
- What you can do after
- Evaluate/understand which inputs merit retention, further engineering, or investigation when a prediction needs explaining.
Read how Machine Learning System Design explains importance score →
Ensemble Methods for Machine Learning
Feature importance is a score representing the contribution or relevance of an input feature to a model's predictions.
- How it is used
- Supports feature selection and communicates which inputs matter most to a model’s overall decisions.
- How deep it goes
- Derives weighted entropy-decrease scores for trees, then contrasts ensemble aggregation with hold-out permutation testing.
- Examples
- Uses two-dimensional data, Iris tree splits, breast cancer diagnosis, and XGBoost ensemble comparisons.
- What you can do after
- Evaluate/understand feature rankings from tree ensembles and test feature reliance through hold-out permutation scores.
Read how Ensemble Methods for Machine Learning explains importance score →
Outlier Detection in Python
Feature importance is a quantitative indication of how much an input feature contributes to a model’s prediction, score, or decision.
- How it is used
- Identifies features relevant to outlier scores when a detector’s scores or labels alone do not explain flagged records.
- How deep it goes
- Distinguishes global from local importance and demonstrates plotting workflows, while emphasizing that rankings need not fully explain scores.
- Examples
- Uses abalone outlier scores, SHAP plots, PyOD IForest rankings, and BHAD’s local and global explanations.
- What you can do after
- Apply it via SHAP or supported detectors to rank relevant features, then assess whether those rankings adequately explain an outlier score.
Read how Outlier Detection in Python explains importance score →
Statistics Every Programmer Needs
Feature importance is a measure of how strongly each input feature contributes to a model's predictions, often based on its effect on split quality.
- How it is used
- Interprets which input variables most affect predictions in decision trees and random forests.
- How deep it goes
- Defines impurity-based scoring, explains relative values, and demonstrates forest-wide visualization without discussing alternative importance methods.
- Examples
- Uses fourth-down conversion prediction, TO_GO, PLAY_TYPE, importance scores, and a sorted bar chart.
- What you can do after
- Apply it via RandomForestClassifier and Matplotlib to rank and visualize influential features.
Read how Statistics Every Programmer Needs explains importance score →
Machine Learning for Tabular Data: XGBoost, Deep Learning, and AI
Feature importance is a measure of how strongly an input feature contributes to a model's predictions or performance.
- How it is used
- Uses feature importance to assess model transparency and communicate which inputs most affect predictions.
- How deep it goes
- Defines importance and demonstrates XGBoost gain scores, but stops short of detailing alternative importance methods or Keras implementation.
- Examples
- Uses a house-market dataset and an Airbnb NYC price-classification model, including gain values, feature rankings, and a bar chart.
- What you can do after
- Apply it via XGBoost’s built-in API to rank features and visualize their relative importance.
Financial AI in Practice
Feature importance is a measure of the contribution or influence of an input feature on a model’s predictions.
- How it is used
- Summarizes overall feature influence for financial model interpretation, risk management, and regulatory review.
- How deep it goes
- Compares four calculation methods and their biases, costs, and reporting tradeoffs, without prescribing a universal choice.
- Examples
- Uses WoE-coded XGBoost features in credit scoring and random-forest feature inspection for market prediction.
- What you can do after
- Diagnose which features drive predictions or model behavior changes and consider those findings in risk interventions.
Read how Financial AI in Practice explains importance score →
Related concepts
- random forestused by · A random forest is an ensemble model that combines predictions from multiple decision trees built with randomized data samples, feature selections, or both.
- permutation feature importanceincludes · Permutation feature importance measures a feature’s importance to a model by randomly permuting its values and assessing the resulting change in predictive performance.
- tree-based methoduses · A tree-based method is a predictive or decision-making technique that represents its rules or decision structure using one or more trees.
- SHAPmeasured by · SHAP is a feature-attribution method that explains model outputs by assigning input features contributions based on Shapley values.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.