How deeply does Building LLM Applications with DSPy cover exploitation?

Contrasts early uncertainty-seeking exploration with later selection of likely high performers, without specifying a quantitative policy.

Exploitation

As explained in Building LLM Applications with DSPy

In optimization, the selection of candidate configurations expected to perform well based on existing evaluations.

Exploitation uses evaluation results to prioritize candidate configurations expected to perform well. It favors promising candidates over less-tested alternatives, balancing the exploration that helps reveal new possibilities. section 6.2.2 section 6.5.1

In Bayesian optimization, initial random trials provide results to guide later choices. MIPROv2 first emphasizes uncertain combinations, then increasingly tests combinations likely to work well; each trial informs the next. section 6.2.2

In genetic algorithms, exploitation means selecting the strongest candidates from a pool and evaluating variations of them. Pool size matters: too few candidates can reduce diversity, while too many can include weak prompts. section 6.5.1

Prompt optimization

A Bayesian optimization trial can pair a set of demonstrations with an instruction. A genetic algorithm can select a top-performing prompt for variation or combination. section 6.2.2 section 6.5.1

How Building LLM Applications with DSPy covers it

Cover of Building LLM Applications with DSPy

liveBook manning.com

Read Building LLM Applications with DSPy on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

Bayesian Optimization in ActionExploitation is an optimization strategy that evaluates regions believed to have high objective performance based on current information.
liveBook manning.com

Optimization Algorithms: AI techniques for design, planning, and control problemsA search strategy that concentrates effort in a region where good solutions have already been found.
liveBook manning.com

Experimentation for EngineersA decision strategy that selects the alternative currently believed to produce the best observed outcome.
liveBook manning.com

Evolutionary Deep Learning: Genetic algorithms and neural networksExploitation is the selection of actions believed to produce the highest available value according to current knowledge.
liveBook manning.com

The AI Pocket BookIn reinforcement learning, the practice of choosing actions believed to maximize current reward based on known information.

Compare how 6 books explain exploitation →

Related concepts

multi-armed banditused by · A multi-armed bandit is a sequential decision problem in which an agent chooses among options with uncertain rewards, balancing reward seeking with gathering information about those options.
exploration-exploitation trade-offcontrasts with · The exploration-exploitation trade-off is the decision problem of balancing actions that gather information about uncertain alternatives with actions chosen for their currently expected payoff.
data explorationcontrasts with · Data exploration is the systematic examination and summarization of data to understand its structure, quality, distributions, relationships, patterns, and anomalies.
Bayesian optimizationused by · Bayesian optimization is a sequential method for optimizing an expensive or unknown objective by using a probabilistic model to guide evaluations.

This explainer was generated by Manning's knowledge graph from the text of Building LLM Applications with DSPy. The section links point to the parts of the book it draws on.