liveBook · Manning

Model adaptation

As explained in Context Engineering

Model customization is the adaptation of a general-purpose model to a particular task, domain, or organizational context.

Model adaptation, or customization, turns a general-purpose foundation model into a context-specific solution. In production, it addresses domain behavior alongside serving configuration, governance controls, and operational constraints. section 9.3.3

Customization techniques intervene at different layers:

  • Fine-tuning updates model weights using domain-specific data, such as support tickets or legal documents. It requires dataset governance, training infrastructure, validation, and rollback plans. section 9.3.3
  • Parameter-efficient fine-tuning trains a small set of additional or decomposed parameters while freezing most base weights. LoRA and adapter modules reduce training cost and simplify version management compared with full fine-tuning. section 9.3.3
  • Prompt learning trains continuous prompt, prefix, or soft-prompt parameters while keeping the main model frozen. Unlike manual prompt engineering, it learns the prompt representation from data. section 9.3.3
  • Alignment optimization adjusts behavior against preference or policy signals; RLHF and direct preference optimization are examples. section 9.3.3
Figure 9.4 LLMOps lifecycle for context-aware systems, from pre-trained model to customization, caching, monitoring, versioning, and deployment
llmops v5

The lifecycle places customization alongside caching, monitoring, versioning, and deployment. section 9.3.3

How Context Engineering covers it

How deep it goes
Contrasts intervention layers and operational burdens, including fine-tuning governance and rollback requirements.
Examples
Uses support tickets, legal documents, financial reports, and internal task demonstrations as potential enterprise training data.
What you can do after
Evaluate adaptation approaches by intervention layer and operational burden.
How it connects
Connects fine-tuning, parameter-efficient fine-tuning, prompt learning, alignment optimization, and LLMOps.

Also explained in

Compare how 2 books explain model adaptation →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Context Engineering. The section links point to the parts of the book it draws on.