8 How to test your dialog flows
This chapter covers:
- Testing each dialog flow in your virtual assistant
- Automating dialog tests
- Gathering unbiased feedback on the user’s experience with your assistant
- Stress testing your assistant with concurrent user tests
FICTITIOUS INC has designed a virtual assistant to handle their most frequent customer service inquiries. They formed a dream team to design and implement conversational flows for each of the major intents their virtual assistant will handle. Now FICTITIOUS INC needs to test their virtual assistant and make sure it works as well as they want it to.
The first conversational flow FICTITIOUS INC will test is for password resets. The reset password design is charted in Figure 1.
Figure 1 FICTITIOUS INC wants to verify the implementation of this Reset Password conversational flow.
FICTITIOUS INC has already evaluated how accurate their assistant was at identifying the intent in a user’s question, including the ability to identify the #reset_password intent. A user who wants their password reset will start the conversation with an utterance indicating their intent. The system will execute several additional steps in a process flow, including asking follow-up questions, before ultimately servicing the #reset_password intent. In this chapter, FICTITIOUS INC will learn how to test those process flow steps.