liveBook · Manning

Prompt management

As explained in Generative AI in Action

Prompt management is the systematic design, testing, deployment, refinement, and operational maintenance of prompts for language models.

Prompt management systematically designs, tests, deploys, refines, and operates prompts for language-model applications. It connects prompt engineering and optimization with evaluations, content moderation, response filtering, and responsible-AI implementations. section 10.3.4

A practical prompt-management program combines three complementary activities:

  • Prompt engineering creates custom, adaptive, and domain-specific instructions for tasks such as summarizing news, responding to user intent, and applying specialized terminology or standards. section 10.3.4
  • Prompt optimization monitors accuracy and relevance, incorporates user feedback and response quality, and reduces unnecessary complexity or token usage. section 10.3.4
  • PromptOps handles operational management, including automated effectiveness testing and version control that supports prompt comparison and rollback. section 10.3.4

Improving an enterprise assistant

An application can adapt a prompt to a user’s intent, test alternative versions with A/B experiments, analyze engagement and accuracy, then refine the selected prompt using response-quality feedback while preserving rollback options. section 10.3.4 section 10.2.3

Prompt management belongs to the orchestration layer, which coordinates services, data flow, prompts, task scheduling, resources, and resilient error handling. It can use interaction analysis and machine-learning models to improve engagement and accuracy. section 10.2.3

How Generative AI in Action covers it

How deep it goes
Explains engineering, optimization, and PromptOps with metrics, feedback, token limits, testing, and version control, but defers fuller governance details.
Examples
Uses news summarization, adaptive user-intent prompts, domain-specific language, interaction analysis, A/B testing, and response-quality feedback.
What it assumes
Assumes familiarity with how language models interpret inputs and with constructing prompts for specific tasks and contexts.
What you can do after
Evaluate/understand prompt performance by monitoring accuracy and relevance, refining from feedback, and managing complexity, tokens, versions, and rollbacks.
How it connects
Connects prompt engineering, prompt optimization, PromptOps, A/B testing, machine learning, content moderation, response filtering, and responsible AI.

Also explained in

Compare how 4 books explain prompt management →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Generative AI in Action. The section links point to the parts of the book it draws on.