Few-shot learning adapts a large language model to a new task at inference time by providing a small number of examples in the prompt. This capability emerges from model scale rather than from explicit task-specific programming. section 1.1.1
It is especially useful when labeled training data is limited. Unlike fine-tuning, it guides behavior through carefully crafted examples without updating the model’s parameters. section 1.5.1
Choose few-shot learning when:
- Training data is limited and high accuracy is desirable, but full parameter updates are not justified. section 1.5.1
- External knowledge is required and retrieved information can be combined with examples that guide style or behavior. section 1.5.1
- Sufficient high-quality examples exist for fine-tuning, because fine-tuning may provide stronger task adaptation than few-shot prompting. section 1.5.1























