liveBook · Manning

NLI

Also called natural language inference

Natural language inference is the task of determining whether a hypothesis is entailed by, contradicts, or is neutral with respect to a premise expressed in natural language.

How 2 Manning books explain it

LLM Evaluation and Alignment, The Foundational Ideas

Natural language inference is the classification of the logical relationship between a premise and a hypothesis as entailment, contradiction, or neutrality.

How it is used
Verifies factual grounding and logical consistency when documents or other reference material define the truth.
How deep it goes
Defines three relationship labels and applies them to sentence-level hallucination scoring through SelfCheckGPT.
Examples
Uses sampled responses as evidence and contrasts revenue increases of 15% and 51% to demonstrate contradiction detection.
What you can do after
Diagnose unsupported or contradictory claims with NLI models in closed-domain applications and lightweight online checks.

Read how LLM Evaluation and Alignment, The Foundational Ideas explains NLI →

Starting Data Analytics with Generative AI and Python

A language-analysis task that determines whether a hypothesis is entailed by, contradicts, or is neutral with respect to a premise.

How it is used
Extends text classification from single texts to relationships between two texts.
How deep it goes
Defines three labels and frames NLI as possible reading comprehension, but defers practical implementation factors.
Examples
Uses a robin premise and hypothesis to illustrate entailment, contradiction, and neutral relationships.
What you can do after
Evaluate relationships between premises and hypotheses using entailment, contradiction, or neutral labels.

Read how Starting Data Analytics with Generative AI and Python explains NLI →

Also covered in

Related concepts

Questions about NLI

What is NLI?

Natural language inference is the task of determining whether a hypothesis is entailed by, contradicts, or is neutral with respect to a premise expressed in natural language.

Which Manning books explain NLI?

LLM Evaluation and Alignment, The Foundational Ideas and Starting Data Analytics with Generative AI and Python.

What is the difference between NLI and LLM-as-a-judge?

Natural language inference is the task of determining whether a hypothesis is entailed by, contradicts, or is neutral with respect to a premise expressed in natural language. LLM-as-a-judge is an evaluation technique in which a language model assesses or compares outputs according to specified criteria.

What is NLI a kind of?

NLI is a kind of classifier. A classifier is a predictive model that assigns an input to one or more discrete classes or categories.

What is NLI also called?

NLI is also called natural language inference.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.