liveBook · Manning

Language model

As explained in Enterprise RAG

A large language model is a machine-learning model trained on extensive text data to understand and generate natural language.

A large language model powers the answer-generation stage of enterprise RAG. It can produce fluent, plausible responses, but may hallucinate facts, making retrieval accuracy, current data, consistency, and graceful uncertainty essential. section 1.2

Production use treats the model as one component in a broader workflow:

  • Ground responses in appropriate, up-to-date databases rather than trusting generation alone. section 1.2
  • Set expectations by communicating capabilities, limitations, and a graceful no-answer response. section 1.2
  • Monitor latency, cost, consistency, and legal or reputational consequences as usage scales. section 1.2

Failure-sensitive customer questions

A customer asking about product availability or features may receive a confident but false answer; an airline chatbot promise demonstrates the potential legal consequences. section 1.2

Figure 1.6 A naive RAG pipeline with limited steps for retrieving answers. Suitable for simple queries but insufficient for handling complex or large-scale enterprise needs.

Use the naive RAG pipeline to locate the model within a retrieval-and-answer workflow and see why limited pipelines do not suit complex enterprise queries. section 1.2

How Enterprise RAG covers it

How deep it goes
Explains hallucination as plausible but false generation, while stopping short of model internals or implementation procedures.
Examples
Uses product availability, product features, and an airline chatbot promise to illustrate factual and legal failure modes.
What you can do after
Evaluate outputs for factuality, communicate limitations, and design retrieval-backed responses with graceful no-answer behavior.
How it connects
Connects to retrieval, enterprise RAG, databases, agents, query rewriting, hallucination, feedback, and answer delivery.

Also explained in

Compare how 89 books explain language model →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Enterprise RAG. The section links point to the parts of the book it draws on.