A foundational model is broadly pretrained on large amounts of text so it can continue language coherently, imitate styles, answer questions, and generate code. It learns these abilities by predicting what comes next rather than by receiving hand-written rules. section 2.2.1 section 2.3
That flexibility does not automatically make the model an assistant. Before fine-tuning, it may treat a prompt as text to continue, producing a question answer, web page, forum post, or story continuation unpredictably. section 2.2.2
The same prompt, different behavior
Give the same request to a foundational model and a fine-tuned conversational model. The foundational model may extend the surrounding text, while the conversational model interprets the input as an instruction and responds directly. Fine-tuning creates this behavioral shift through carefully curated prompt-response examples. section 2.2.2
Fine-tuning builds on the pretrained foundation with a smaller, higher-quality dataset. Later alignment training can shape preferred behavior and guardrails, while further domain training can produce specialized models for coding, medicine, law, or multimodal tasks. section 2.3





























