liveBook · Manning

Triage

As explained in Effective Conversational AI

Problem triage is the systematic evaluation and prioritization of identified system problems according to factors such as effect, frequency, and resolution effort.

When a chatbot repeatedly misunderstands users or sends them to agents, triage evaluates and prioritizes the problems most worth fixing. It weighs effect, frequency, resolution effort, value, and expected return rather than treating every defect equally. section 3.4.2

A practical triage process:

  • Document each problem, likely causes, proposed solutions, affected flows, conversation volume, and user outcomes. section 3.4.2
  • Compare benefits with costs, including time, effort, fix complexity, cross-department coordination, and human-agent expense. section 3.4.2
  • Prioritize changes whose expected return justifies investment, especially when many conversations are affected. section 3.4.2

Appointment booking

In PharmaBot, misunderstanding appointment types blocked a core booking workflow, so it received the highest priority. A cost estimate for frustrated users transferred to call-center agents can strengthen that decision. section 3.4.2

How Effective Conversational AI covers it

How deep it goes
Evaluates documented problems through causes, effects, frequency, effort, costs, benefits, and expected return.
Examples
Uses appointment-type misunderstandings, escalated conversations, abandoned chats, and human-agent costs as prioritization cases.
What it assumes
Starts with identified problems and requires evidence about causes, affected conversations, outcomes, and remediation effort.
What you can do after
Apply a structured ranking process that selects fixes whose benefits justify their implementation costs.
How it connects
Links chatbot improvements with cost-benefit analysis, conversational outcomes, containment, and effect-effort prioritization.

Also explained in

Compare how 2 books explain triage →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Conversational AI. The section links point to the parts of the book it draws on.