liveBook · Manning

Training

As explained in Build an Advanced RAG Application (From Scratch)

Model training is the process of optimizing a model's parameters from data so that it learns a target task or distribution.

Model training exposes a language model to extensive data and optimizes its parameters so it learns language patterns and predicts likely next words. The process repeatedly adjusts weights and biases to reduce the difference between predictions and observed outcomes. section 1.1.2

Training proceeds through a repeated prediction-and-adjustment loop:

  • Expose the model to diverse examples of human language. section 1.1.2
  • Predict the next word from the input sequence. section 1.1.2
  • Adjust weights, which control connection strength, and biases, which support predictions even without input. section 1.1.2
  • Repeat the adjustments until the model reaches satisfactory proficiency, using substantial computational resources and time. section 1.1.2

Training provides the language foundation behind applications such as chatbots, summarization, and content generation. Application development also considers training and fine-tuning alongside hardware selection and the intended NLP task. section 1.1.2 section 1.2

How Build an Advanced RAG Application (From Scratch) covers it

How deep it goes
Defines next-word prediction, weights, biases, iterative adjustment, and compute costs without specifying an optimization algorithm.
Examples
Uses human-language data, next-word prediction, chatbots, summarization, content generation, and sentiment analysis.
What it assumes
Assumes basic awareness of LLMs and introduces weights, biases, and iterative parameter adjustment.
What you can do after
Evaluate/understand how data exposure and parameter updates improve language-pattern predictions and inform compute planning.
How it connects
Connects training with fine-tuning, model parameters, language models, GPUs, and NLP application design.

Also explained in

Compare how 32 books explain training →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Build an Advanced RAG Application (From Scratch). The section links point to the parts of the book it draws on.