How deeply does Transformers in Action cover zero-shot learning?

Defines generalization beyond training and contrasts few-shot learning, but stops short of implementation procedures or model internals.

Zero-shot learning

As explained in Transformers in Action

Zero-shot learning is the ability to perform a task or recognize classes without task-specific examples during adaptation or inference.

Zero-shot learning enables a model to perform tasks it was never specifically trained for. It relies on broad pre-existing training rather than task-specific examples or explicit retraining during adaptation or inference. section 1.3 section 1.5

The technique expands the practical reach of pretrained transformers, making existing model knowledge usable across new tasks while reducing the time and resources required for task-specific training. Few-shot learning differs by using a small amount of task-related data. section 1.3 section 1.5

Use zero-shot learning with the following trade-offs:

Leverage a pretrained transformer when a new task lacks task-specific examples. section 1.3
Balance generalization benefits against weaker performance in specialized domains such as finance or healthcare. section 1.3 section 1.5
Distinguish zero-shot prompting from broader prompt-engineering methods, including one-shot and few-shot prompting. section 4.2

How Transformers in Action covers it

liveBook manning.com

Read Transformers in Action on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

Introduction to Generative AI, Second EditionZero-shot learning is performing a task without task-specific labeled examples or demonstrations.
liveBook manning.com

Starting Data Analytics with Generative AI and PythonA zero-shot learning model performs a task or makes predictions for categories without task-specific examples for those categories during inference.
liveBook manning.com

Sutskever's ListA zero-shot setting evaluates a model on a task or query without providing task-specific examples in the input.
liveBook manning.com

LLMs in ProductionA learning or inference setting in which a model performs a task without being given task-specific examples.
liveBook manning.com

Knowledge Graphs and LLMs in ActionZero-shot learning is performing a task without task-specific examples, relying on a task description and pretrained knowledge.
liveBook manning.com

Generative AI in ActionZero-shot learning is the ability to perform a task or recognize classes not directly represented in task-specific training examples by relying on broader learned associations or descriptions.
liveBook manning.com

Hugging Face in ActionZero-shot classification is the assignment of labels to inputs without task-specific labeled examples during model adaptation or inference.
liveBook manning.com

Build a Large Language Model (From Scratch)A learning setup where a model handles a task without having seen any task-specific examples beforehand.
liveBook manning.com

Reinforcement Learning from Human FeedbackZero-shot evaluation measures a model on questions or tasks without providing task-specific examples in the prompt.

Compare how 10 books explain zero-shot learning →

Related concepts

few-shot learningcontrasts with · Few-shot learning is the adaptation or performance of a model on a task using only a small number of task-specific examples.
prompt engineeringused by · Prompt engineering is the deliberate design and refinement of instructions, context, examples, or other inputs to guide an AI model’s behavior or outputs.
one-shot learningcontrasts with · One-shot learning is a machine-learning setting in which a model generalizes to recognize or perform a task from a single labeled or demonstrated example.
pretraininguses · Pretraining is the initial training of a model on broad data to learn general patterns or capabilities before adaptation to specific tasks or domains.
DetectGPTincludes · DetectGPT is a zero-shot method for detecting machine-generated text by analyzing changes in language-model likelihoods under perturbations.
NLIuses · Natural language inference is the task of determining whether a hypothesis is entailed by, contradicts, or is neutral with respect to a premise.

This explainer was generated by Manning's knowledge graph from the text of Transformers in Action. The section links point to the parts of the book it draws on.