liveBook · Manning

Unlabeled data

As explained in Building LLM Applications with DSPy

Data examples that lack target outputs or labels.

Unlabeled data consists of examples with inputs but no target outputs. For summarization, an example can contain the original document without a ground-truth summary. section 8.1.2

DSPy can use these examples for evaluation and optimization. This is useful when creating clear, meaningful summaries by hand—or generating them for human confirmation—is difficult and time-consuming. section 8.1.2

How Building LLM Applications with DSPy covers it

How deep it goes
Defines input-only examples and their use for evaluation and optimization, without detailing the optimization procedure.
Examples
Uses original documents without ground-truth summaries as summarization examples.
What it assumes
Assumes input examples and contrasts them with classification, which requires ground-truth labels for evaluation or optimization.
What you can do after
Apply it via DSPy to evaluate and optimize examples without ground-truth summaries.
How it connects
Connects summarization with evaluation, optimization, and labeled-data comparison.

Also explained in

Compare how 4 books explain unlabeled data →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Building LLM Applications with DSPy. The section links point to the parts of the book it draws on.