liveBook · Manning

Small language model

Also called SLMs

A small language model is a comparatively compact language model with limited parameters or capacity and typically lower computational and storage requirements than larger models.

How 3 Manning books explain it

Transformers in Action

A small language model is a relatively compact language model designed to provide efficient inference with fewer parameters and lower resource requirements than larger models.

How it is used
Uses compact models as standalone specialists and auxiliary components in larger AI pipelines.
How deep it goes
Works through dataset preparation, fine-tuning, and evaluation for classification and generation, with practical deployment trade-offs.
Examples
Uses financial sentiment classification, prosocial dialogue adaptation, and English-to-Spanish translation.
What you can do after
Apply it via Hugging Face and TRL to fine-tune and evaluate compact classification and generation models.

Read how Transformers in Action explains small language model →

Rearchitecting LLMs

A small language model is a language model with comparatively limited parameters and computational requirements, typically optimized for efficient deployment.

How it is used
Uses specialized SLMs to replace oversized models on narrow tasks and reduce deployment costs or latency.
How deep it goes
Develops a pruning-and-distillation workflow and addresses validation, serving constraints, and fallback routing.
Examples
Uses an agent tool-argument call and a small mixture of experts to illustrate specialization.
What you can do after
Builds a specialized model through pruning and distillation, then evaluates its suitability for deployment.

Read how Rearchitecting LLMs explains small language model →

The Art of AI Product Development

A small language model is a compact language model with relatively few parameters, designed to provide efficient task-specific language processing and generation.

How it is used
Deploys efficient language processing for focused, high-volume tasks where cost, speed, and responsiveness outweigh broad generative capability.
How deep it goes
Defines parameter scale, strengths, limitations, and selection criteria, but stops short of implementation internals.
Examples
Uses competitor-content analysis, topic classification, DistilBERT, Phi-2, T5, and labeled document datasets as concrete examples.
What you can do after
Evaluate task fit, compare candidate models, and justify an efficient SLM deployment for focused language-processing workloads.

Read how The Art of AI Product Development explains small language model →

Also covered in

What to know first

Related concepts

Questions about small language model

What is small language model?

A small language model is a comparatively compact language model with limited parameters or capacity and typically lower computational and storage requirements than larger models.

Which Manning books explain small language model?

Transformers in Action, Rearchitecting LLMs and The Art of AI Product Development.

What should I know before learning small language model?

Manning books that teach small language model usually introduce language model, fine-tuning, AI agent and accuracy first.

What is the difference between small language model and language model?

A small language model is a comparatively compact language model with limited parameters or capacity and typically lower computational and storage requirements than larger models. A language model is a computational model that represents patterns in linguistic sequences to assign probabilities, predict, generate, or evaluate language.

What kinds of small language model are there?

Kinds of small language model include Gemma 3 270M.

What is small language model also called?

Small language model is also called SLMs.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.