Intercept
An intercept is an additive constant parameter in a model that shifts its output independently of its input features.
Grokking Machine Learning, Second Edition
The value of a linear function when all input variables are zero, represented by the constant term.
- How it is used
- Sets the constant starting prediction in linear regression and shifts the score used by perceptron classification.
- How deep it goes
- Defines the intercept geometrically and procedurally, then extends it to multifeature regression, perceptron thresholds, and training updates.
- Examples
- Uses house prices, lines in the plane, alien-language sentiment classification, and a scikit-learn housing-price model.
- What you can do after
- Evaluate/understand linear-model predictions and classifier scores by separating the constant bias from feature-weight contributions.
Read how Grokking Machine Learning, Second Edition explains intercept →
Grokking Machine Learning
The value of a linear function when its input features are zero, corresponding to where the line crosses the y-axis.
- How it is used
- Anchors housing-price predictions as the base value added to feature contributions.
- How deep it goes
- Defines the axis crossing and zero-feature prediction, then shows how intercept updates move a single-feature regression line.
- Examples
- Uses a room-count price equation and an area-only Hyderabad housing model with a negative fitted intercept.
- What you can do after
- Apply it via Turi Create to inspect a fitted intercept alongside its feature coefficient.
Statistics Every Programmer Needs
An intercept is the predicted value of a response variable when all predictors in a linear equation equal zero.
- How it is used
- Anchors linear-regression predictions at a predictor value of zero and combines with slope estimates to form a fitted equation.
- How deep it goes
- Defines the zero-predictor interpretation and works through coefficient-based prediction and statsmodels fitting.
- Examples
- Uses Stage 1 and Stage 2 running times, a fitted equation, and a 193-minute input yielding an approximately 249-minute prediction.
- What you can do after
- Apply it via statsmodels by adding a constant, fitting OLS, and using the reported intercept with the slope to predict a response.
Read how Statistics Every Programmer Needs explains intercept →
Build AI Drug Discovery Pipelines
An intercept is the constant term in a linear model that represents the predicted output when all input features are zero.
- How it is used
- Uses the intercept to establish a baseline prediction in solubility regression and as a bias in neural-network layers.
- How deep it goes
- Defines the constant term, embeds it as a bias parameter, and stops short of deriving its fitted value.
- Examples
- Uses a logP-based solubility line and fully connected PyTorch layers to illustrate intercept and bias behavior.
- What you can do after
- Apply it via scikit-learn by interpreting w₀ as the baseline prediction in a fitted linear regression model.
Read how Build AI Drug Discovery Pipelines explains intercept →
Math and Architectures of Deep Learning
A learned additive parameter that shifts model output independently of the inputs.
- How it is used
- Uses the intercept to shift weighted model outputs and place classification thresholds.
- How deep it goes
- Defines the additive parameter, explains its geometric effect, and demonstrates threshold changes, but defers implementation internals.
- Examples
- Demonstrates threat scoring, signed-distance separation, and AND and OR perceptrons with contrasting biases.
- What you can do after
- Apply it by interpreting and configuring additive parameters in weighted models and perceptrons.
Read how Math and Architectures of Deep Learning explains intercept →
Timeless Algorithms, The Foundational Ideas
A bias term is an additive constant that shifts a model's output independently of its input features.
- How it is used
- Sets a baseline or shifts a decision boundary independently of feature contributions in classification and neural-network calculations.
- How deep it goes
- Defines the intercept’s role in regression and explains its effect on SVM boundaries and neural-network nodes, without detailing estimation for every model.
- Examples
- Uses a study-hours regression fit and a two-feature SVM decision function to illustrate intercept effects.
- What you can do after
- Evaluate/understand how an additive constant affects a predicted response, log-odds, decision boundary, or node activation.
Read how Timeless Algorithms, The Foundational Ideas explains intercept →
Natural Language Processing in Action, Second Edition
A bias is a constant input signal, conventionally equal to one, that allows a neuron to shift its activation independently of the other inputs.
- How it is used
- Uses the intercept as the neuron’s trainable baseline when calculating perceptron or logistic-regression predictions.
- How deep it goes
- Explains the intercept-to-bias correspondence and weighted-sum implementation, stopping at feed-forward calculation rather than learning procedures.
- Examples
- Demonstrates bias handling with a four-token count vector, randomly initialized weights, a weighted sum, and a zero threshold.
- What you can do after
- Build a perceptron feed-forward calculation by prepending a constant one and pairing it with a dedicated trainable weight.
Read how Natural Language Processing in Action, Second Edition explains intercept →
Data Without Labels
A bias term is a learnable additive neural-network parameter that shifts a unit's pre-activation independently of its weighted inputs.
- How it is used
- Uses the intercept as a trainable neural-network parameter that shifts activation inputs alongside weights.
- How deep it goes
- Defines the bias through a linear-function analogy and feed-forward role, but defers detailed activation-function treatment.
- Examples
- Uses face identification, labeled face images, threshold behavior, and neuron diagrams to illustrate the parameter.
- What you can do after
- Evaluate/understand how bias values participate in perceptron computation, parameter training, and feed-forward prediction.
Grokking AI Algorithms, Second Edition
A neural-network bias is a learned additive parameter that shifts a layer's computed output independently of its weighted inputs.
- How it is used
- Explains how neural-network layers shift weighted outputs to fit data more flexibly.
- How deep it goes
- Traces weighted multiplication, per-dimension bias addition, ReLU, and a second bias before the residual connection.
- Examples
- Uses an intercepting-line analogy and explicit eight- and four-value bias vectors in feed-forward layer calculations.
- What you can do after
- Apply it via vector arithmetic to adjust layer outputs before activation or residual addition.
Read how Grokking AI Algorithms, Second Edition explains intercept →
Machine Learning Algorithms in Depth
A bias parameter is a learned additive parameter that shifts a neural-network layer's preactivation values.
- How it is used
- Uses intercepts to shift regression predictions and parameterize neural-network layers.
- How deep it goes
- Defines intercepts in hierarchical regression and connects them to bias parameters, but does not derive their optimization or gradient updates.
- Examples
- Uses county-level radon regression with basement status and neural-network layers as concrete modeling contexts.
- What you can do after
- Evaluate/understand how additive intercepts function in county-level Bayesian regression and as neural-network bias parameters.
Read how Machine Learning Algorithms in Depth explains intercept →
Grokking Bayes
A bias is a learnable additive parameter in a neural-network transformation that shifts its output independently of the input.
- How it is used
- Positions the baseline prediction in linear regression and the additive offset in neural-network transformations.
- How deep it goes
- Defines the intercept through y = mx + b and connects it to neural-network bias terms, while simplifying one regression discussion by setting it to zero.
- Examples
- Uses house area and price for regression, plus layered neural-network transformations with weights and biases.
- What you can do after
- Evaluate how an additive parameter changes predictions in linear regression and neural-network transformations.
Also covered in
- Build an Advanced RAG Application (From Scratch)In early access (MEAP)
- Build a Robo-Advisor with Python (From Scratch)
- Deep Learning with JAX
- Math for Web Design
What to know first
- linear regressionLinear regression is a statistical method that models a numeric response as a linear function of one or more predictor variables with fitted parameters.
- language modelA language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.
- normal distributionA normal distribution is a continuous probability distribution with a symmetric, bell-shaped density determined by its mean and variance.
- dimensionA dimension is an independent coordinate or feature axis used to represent points or data; the dimensionality of a representation is the number of such axes or components.
Related concepts
- parameterkind of · A parameter is a value or named input that specifies or influences the behavior, computation, or output of a function, model, or system.
- alphaequivalent to · Alpha is investment performance beyond a relevant benchmark or the return explained by specified systematic risk factors.
- biasequivalent to · Bias is a systematic tendency or deviation that distorts measurements, estimates, judgments, or outcomes relative to a relevant reference or target.
- classification scoreequivalent to · A classification score is a real-valued output representing a classifier’s support, confidence, or signed strength for a predicted class.
- line equationpart of · A line equation is an equation linear in its variables that represents a straight line in two dimensions or a linear relationship in higher dimensions.
- linear regressionused by · Linear regression is a statistical method that models a numeric response as a linear function of one or more predictor variables with fitted parameters.
Questions about intercept
What is intercept?
An intercept is an additive constant parameter in a model that shifts its output independently of its input features.
Which Manning books explain intercept?
Grokking Machine Learning, Second Edition, Grokking Machine Learning, Statistics Every Programmer Needs, Build AI Drug Discovery Pipelines, Math and Architectures of Deep Learning, Timeless Algorithms, The Foundational Ideas, Natural Language Processing in Action, Second Edition, Data Without Labels and 3 more.
What should I know before learning intercept?
Manning books that teach intercept usually introduce linear regression, language model, normal distribution and dimension first.
What is intercept a kind of?
Intercept is a kind of parameter. A parameter is a value or named input that specifies or influences the behavior, computation, or output of a function, model, or system.
What is intercept part of?
Intercept is part of line equation. A line equation is an equation linear in its variables that represents a straight line in two dimensions or a linear relationship in higher dimensions.
What is intercept also called?
Intercept is also called bias, biases or b.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.










