Parameter count
Parameter count is the number of numerical parameters in a model that are learned or adjusted during training.
Deep Learning with R, Third Edition
Model size is the amount of structural and parameter capacity in a machine learning model, determined by features such as layer and unit counts.
- How it is used
- Uses model size to balance sufficient capacity against overfitting on a given dataset.
- How deep it goes
- Describes an iterative validation-loss workflow but gives no formula for calculating parameter counts.
- Examples
- Compares IMDb review classifiers with four, 16, and 512 units in each hidden layer.
- What you can do after
- Evaluate candidate model sizes by comparing validation loss as layers or layer sizes increase.
Read how Deep Learning with R, Third Edition explains parameter count →
Build Applications with Local AI Models on a Mac
Model size is a measure of a language model's scale, commonly expressed by its number of learned parameters.
- How it is used
- Uses parameter count as a first filter for choosing a local model that fits the task and available RAM.
- How deep it goes
- Defines learned parameters and explains practical size tradeoffs, without detailing how those values are learned.
- Examples
- Compares gemma3:4b with larger laptop options and tabulates Whisper parameter counts against transcription speed and accuracy.
- What you can do after
- Operate/configure it: choose an Ollama model using its size tag, available RAM, and current library listing.
Read how Build Applications with Local AI Models on a Mac explains parameter count →
Software Testing with Generative AI
The number of learned statistical parameters, or weights, in a machine-learning model.
- How it is used
- Uses parameter count to compare language models and estimate whether their resource demands may justify their value.
- How deep it goes
- Defines parameters as statistical weights and connects their quantity to performance and cost, stopping short of model internals.
- Examples
- Uses 175-billion-parameter and 1-trillion-parameter language models as comparison examples.
- What you can do after
- Evaluate/understand model scale as a rough performance and cost indicator without treating it as proof of quality.
Read how Software Testing with Generative AI explains parameter count →
Related concepts
- parametermeasures · A model parameter is a numerical value, such as a weight or bias, that is learned or set to determine how a model computes outputs.
- generalizationcontrasts with · Generalization is the extension of a pattern, model, solution, or conclusion beyond the specific examples or cases from which it was derived.
- computeproduces · Compute is the processing capacity and computational resources available to or consumed by a system when executing workloads.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.