8 Testing your dialogue flows

 

This chapter covers

  • Testing each dialogue flow in your conversational AI
  • Automating dialogue tests
  • Gathering unbiased feedback on the user’s experience with your assistant
  • Stress-testing your assistant with concurrent user tests

Fictitious Inc. has designed a conversational AI to handle its most frequent customer service inquiries. The company formed a dream team to design and implement conversational flows for each of the major intents the assistant will handle. Now it needs to test the conversational assistant and make sure that it works as well as desired.

The first conversational flow to be tested is password resets (figure 8.1).

Figure 8.1 Verifying the implementation of a reset password conversational flow

Fictitious Inc. has already evaluated how accurate the assistant is at identifying the intent in a user’s question, including the ability to identify the #reset_ password intent. A user who wants their password reset will start the conversation with an utterance indicating their intent. The system will execute several additional steps in a process flow, including asking follow-up questions, before ultimately servicing the #reset_password intent.

8.1 Functionally testing a dialogue flow

 
 
 

8.1.1 Manually testing a conversation flow

 
 

8.1.2 Automating a conversation flow test

 
 

8.1.3 Testing the dialogue flowchart

 

8.1.4 Testing the unexpected error paths

 
 

8.2 Nonfunctionally testing a dialogue flow

 
 

8.2.1 User experience testing

 
 
 

8.2.2 Load testing

 

Summary

 
 
 
sitemap

Unable to load book!

The book could not be loaded.

(try again in a couple of minutes)

manning.com homepage
test yourself with a liveTest