How deeply does Building Reliable AI Systems cover parameter-efficient fine-tuning?

Explains LoRA’s frozen base and trainable adapters, then compares LoRA and QLoRA by parameter efficiency, performance, and memory.

Parameter-efficient fine-tuning

As explained in Building Reliable AI Systems

Fine-tuning methods that adapt a small subset or representation of a model’s parameters to reduce training resource requirements.

Full fine-tuning can demand substantial GPU memory and computation, and updating every weight risks catastrophic forgetting. Parameter-efficient fine-tuning (PEFT) reduces training demands by adapting only a small fraction of model parameters. section 5.3.3

Two practical PEFT approaches are:

LoRA freezes the base model and trains small adapter matrices added to selected model components. section 5.3.3
QLoRA extends LoRA and uses less memory; its reported performance is somewhat lower than LoRA’s. section 5.3.3

Fine-tuning is useful for specialized tasks when prompting and retrieval alone are insufficient. High-quality, well-formatted training data remains important; combining fine-tuning with retrieval can provide live knowledge access alongside consistent reasoning. section 5.5

Table 5.2 Comparing different fine-tuning methods

Method	Parameter efficiency	Performance	Memory usage	When to choose
Full fine-tuning	Lowest (100%)	Highest	Highest	When you have multiple high-end GPUs and need maximum adaptation
LoRA	High (~0.1–1%)	Very high (95–99% of full)	Low	When you have a decent GPU and need strong performance
QLoRA	High (~0.1–1%)	High (90–95% of full)	Lowest	When you have limited GPU resources but need to fine-tune large models

Compare parameter efficiency, performance, memory use, and hardware guidance when choosing between full fine-tuning, LoRA, and QLoRA. section 5.3.3

How Building Reliable AI Systems covers it

liveBook manning.com

Read Building Reliable AI Systems on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

LLMs in ProductionParameter-efficient fine-tuning is a fine-tuning approach that adapts a model by training only a small subset of parameters or added parameters.
liveBook manning.com

The Art of AI Product DevelopmentParameter-efficient fine-tuning is a fine-tuning method that adapts a model by updating a small subset or additional parameterization rather than all model parameters.
liveBook manning.com

Domain-Specific Small Language ModelsA family of fine-tuning methods that adapt a pretrained model using only a small subset of parameters or added modules to reduce compute and cost.
liveBook manning.com

Financial AI in PracticeParameter-efficient fine-tuning adapts a pretrained model by training a small subset of its parameters or adding lightweight trainable components.

Compare how 5 books explain parameter-efficient fine-tuning →

Related concepts

low-rank adaptationincludes · Low-rank adaptation is a parameter-efficient fine-tuning method that adapts a model by learning low-rank updates to its weights, typically while keeping most original weights fixed.
fine-tuningkind of · Fine-tuning is adapting a pretrained machine-learning model by training it further on targeted data or objectives for a task, domain, or behavior.
QLoRAincludes · QLoRA is a parameter-efficient fine-tuning method that quantizes a pretrained model’s weights while training low-rank adapters to reduce memory requirements.
catastrophic forgettingaddresses · Catastrophic forgetting is the substantial loss of previously learned information or capabilities when a model learns new data, tasks, or objectives.

This explainer was generated by Manning's knowledge graph from the text of Building Reliable AI Systems. The section links point to the parts of the book it draws on.