Compaction

As explained in The Art of AI Product Development

Prompt compression is the reduction of prompt context and examples while preserving information needed for high-quality model outputs.

How The Art of AI Product Development covers it

How deep it goes

Defines compression as summarizing context and examples while preserving their essence; gives no specific procedure.

What you can do after

Apply it by summarizing context and examples to use fewer tokens while aiming to maintain high-quality outputs.

How it connects

Connects prompt compression to few-shot prompting, chain-of-thought prompting, prompt optimization, and token costs.

liveBookmanning.com

Read The Art of AI Product Development on liveBook Get the book at manning.com

Also explained in

• 

  liveBookmanning.com
  Architecting an Apache Iceberg LakehouseA compaction strategy defines how fragmented data and delete files are consolidated based on factors such as activity, size, or freshness.
• 

  liveBookmanning.com
  ScyllaDB in ActionCompaction is a storage-maintenance process that merges multiple immutable database files into fewer, more compact files while reconciling their contents.
• 

  liveBookmanning.com
  .NET in Action, Second EditionGarbage-collection compaction moves live objects together to reduce fragmentation and create larger contiguous free-memory regions.
• 

  liveBookmanning.com
  Build an AI Agent (From Scratch)A compaction strategy replaces processed or externally stored content in an agent's context with lightweight references that permit later retrieval.

Compare how 5 books explain compaction →

Related concepts

• deletioncontrasts with · Deletion is an operation that removes an item, association, or resource from a collection or system, or requests or marks it for removal.
• summarizationimplemented by · Summarization is the process of condensing source content into a shorter representation that preserves its important information or meaning.

This explainer was generated by Manning's knowledge graph from the text of The Art of AI Product Development. The section links point to the parts of the book it draws on.