liveBook · Manning

Intercept

As explained in Grokking Bayes

A bias is a learnable additive parameter in a neural-network transformation that shifts its output independently of the input.

An intercept is the parameter that sets a model’s predicted response when its predictors are zero. In the line y = mx + b, b shifts the line up or down, while m controls its slope. section 3.10

The intercept appears in several related modeling settings:

  • For house-price prediction, square footage is x and price is y; the intercept represents the model’s baseline prediction when x equals zero. section 3.10
  • In a neural network, the bias term b accompanies the weights in each linear transformation, producing y = mx + b. section 10.1
  • Linear-regression discussions may set b = 0 temporarily to simplify the mathematics, even though a full model usually includes it. section 3.10

A baseline prediction

Suppose a fitted line is y = mx + b. Setting x to zero leaves y = b, so the intercept is the line’s predicted response at that reference point. In a neural network, the same additive term is called a bias. section 3.10 section 10.1

Figure 10.2 The architecture of an example neural network with two hidden layers of size 6 and 4.

Use the network architecture figure to locate bias terms alongside weights across the model’s layers. section 10.1

How Grokking Bayes covers it

How deep it goes
Defines the intercept through y = mx + b and connects it to neural-network bias terms, while simplifying one regression discussion by setting it to zero.
Examples
Uses house area and price for regression, plus layered neural-network transformations with weights and biases.
What you can do after
Evaluate how an additive parameter changes predictions in linear regression and neural-network transformations.
How it connects
Connects the intercept to slope, linear regression, weights, neural networks, and gradient descent.

Also explained in

Compare how 11 books explain intercept →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Grokking Bayes. The section links point to the parts of the book it draws on.