liveBook · Manning

Solutioning

As explained in Effective Conversational AI

Solutioning is the process of outlining a high-level fix by defining its responsibilities, required changes, implementation approach, and effort.

When a high-priority chatbot problem is identified, solutioning turns it into a practical high-level fix: assign responsibility, define the required changes, choose an implementation approach, and estimate development effort. section 3.4.2

A useful solutioning discussion answers four questions:

  • Who will implement the fix, including relevant roles and responsibilities? section 3.4.2
  • What must change: dialogue responses, contextual understanding, intent recognition, or another capability? section 3.4.2
  • How will the change be implemented, including its technical approach and dependencies? section 3.4.2
  • How much effort will it require, considering coding complexity, integrations, and external systems? section 3.4.2

From problem to proposed fix

If users cannot complete a chatbot flow, a team might identify a flow redesign as a high-effect, high-effort fix. If intent confusion causes incorrect responses, it might examine imbalanced training data and differences between training examples and real queries before choosing a remedy.

Figure 3.17 An effect-effort matrix visualizes the relationship between the effort required and the potential effect of a proposed change.
figure

Use the effect-effort matrix to compare proposed changes and focus attention on improvements with the greatest potential effect for the required effort. section 3.4.2

How Effective Conversational AI covers it

How deep it goes
Defines four planning questions and effort factors but stops short of prescribing detailed implementation steps.
Examples
Uses incomplete flows, insufficient intents, API failures, and intent confusion as candidate problems for proposed fixes.
What it assumes
Assumes a prioritized problem has already been identified and a team is available to formulate the fix collaboratively.
What you can do after
Evaluate and outline a chatbot fix by assigning ownership, defining changes, selecting an approach, and estimating effort.
How it connects
Connects effect-effort matrices with dialogue flows, intent recognition, contextual understanding, and continuous improvement.

This explainer was generated by Manning's knowledge graph from the text of Effective Conversational AI. The section links point to the parts of the book it draws on.