liveBook · Manning

User survey

As explained in Effective Conversational AI

A survey is a structured instrument for collecting responses about people's experiences, opinions, or needs.

A user survey collects direct feedback about a chatbot experience, revealing frustrations and expectations that conversation metrics and logs may only suggest indirectly. Keep it brief because longer surveys reduce completion rates. section 3.3.2 section 3.4.1

From complaint to improvement target

A user reports that vaccine-eligibility answers ignore different states, while another finds appointment scheduling confusing and a third waits nearly five minutes for availability. Categorizing these responses turns frustration into concrete problems: missing context, unclear guidance, and excessive response time. section 3.4.1

Use surveys as part of an improvement loop:

  • Ask about ease of use, helpfulness, and overall satisfaction after the interaction. section 3.3.2
  • Combine responses with conversation transcripts to distinguish reported frustration from inferred failure. section 3.4.1
  • Look for repeated problems before prioritizing solutions; isolated responses may not represent the broader user population. section 3.4.1
  • Encourage participation with a small incentive or a genuine thank-you, while recognizing that response rates are often low. section 3.3.2 section 3.4.1

How Effective Conversational AI covers it

How deep it goes
Explains brief post-interaction questions, feedback categorization, transcript comparison, participation limits, and caution against isolated conclusions.
Examples
Uses complaints about state-specific eligibility, confusing appointment scheduling, and slow availability responses to identify chatbot pain points.
What it assumes
Assumes access to chatbot users and interaction records while teaching direct feedback collection alongside existing metrics and logs.
What you can do after
Diagnose recurring chatbot deficiencies by collecting, categorizing, and comparing user feedback with conversation transcripts.
How it connects
Connects user surveys with customer satisfaction, conversation logs, conversation transcripts, qualitative feedback, and quantitative analysis.

Also explained in

Compare how 6 books explain user survey →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Conversational AI. The section links point to the parts of the book it draws on.