liveBook · Manning

Conversational search

As explained in Effective Conversational AI

Conversational search is an interaction pattern that retrieves information through natural-language dialogue and presents it as a conversational response.

A user asks an open-ended question after “How can I help you?” The assistant fails to recognize it, requests a rephrase, and risks frustration or immediate opt-out. Conversational search addresses this failure by supporting broader natural-language questions instead of relying only on predefined intents. section 11.3.1

Conversational search retrieves information through dialogue and returns a conversational answer. It can search a knowledge base and use an LLM to generate an answer, rely on an LLM’s built-in knowledge, or combine search with predefined intents in a hybrid design. section 1.1.3

Choose the interaction pattern according to the breadth and predictability of user questions:

  • Use intent-and-response matching for recurring, well-defined questions. section 1.1.3
  • Use conversational search or retrieval-augmented generation for broad domains and question-answering use cases. section 11.3.1
  • Use a hybrid model when common questions deserve intents while less predictable questions route to search or generative AI. section 1.1.3
  • Keep training relevant to current user needs so the assistant does not become stale or repeatedly ask users to rephrase. section 11.3.1

From fixed intents to broader questions

A store-hours request may use a simple API that returns the same answer for everyone. A broader company question can instead search a knowledge base and generate a response; frequent questions can remain mapped to intents while other questions use search. section 1.1.3

How Effective Conversational AI covers it

How deep it goes
Explains LLM, knowledge-base, and hybrid patterns but stops short of implementation details or evaluation procedures.
Examples
Uses store-hours APIs, FAQ utterance matching, knowledge-base answers, hybrid routing, and open-ended requests that trigger rephrasing.
What you can do after
Evaluate whether conversational search, intent matching, or a hybrid approach best fits users’ question breadth and predictability.
How it connects
Connects conversational search with intent recognition, retrieval-augmented generation, large language models, knowledge bases, APIs, and FAQ bots.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Conversational AI. The section links point to the parts of the book it draws on.