liveBook · Manning

Parameter

As explained in Introduction to Generative AI, Second Edition

A model parameter is a learned numerical value that determines how a machine-learning model transforms inputs, with parameter count indicating model scale.

A parameter is a learned numerical value that helps a neural network transform inputs. Weights represent connection strength, while a bias term adjusts the combined result. section 1.1

Training repeatedly updates these values using data until the model performs well for its objective. Parameter count, commonly referring to learned weights, serves as a rough shorthand for model complexity and capability—not a guarantee of performance. section 1.1

A large language model

Large language models can contain more than one trillion parameters. Increasing network size and depth can improve performance when sufficient data is available, but scale remains connected to data and does not stand alone. section 1.1

How Introduction to Generative AI, Second Edition covers it

How deep it goes
Defines weights, biases, training updates, and parameter counts, while deferring the precise mathematics of training.
Examples
Uses neural-network connections and large language models exceeding one trillion parameters as examples.
What it assumes
Assumes basic input-and-connection intuition and introduces weights, biases, training, and parameter counts without mathematical detail.
What you can do after
Evaluate model scale and understand how training adjusts numerical values that influence model behavior.
How it connects
Connects parameters with neural networks, weights, biases, training data, deep learning, and model complexity.

Also explained in

Compare how 31 books explain parameter →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Introduction to Generative AI, Second Edition. The section links point to the parts of the book it draws on.