liveBook · Manning

LLMOps

Also called large language model operations

LLMOps is the set of engineering and operational practices for developing, deploying, evaluating, monitoring, and maintaining large language model systems and applications.

How 7 Manning books explain it

Generative AI in Action

LLMOps is the set of operational practices for developing, deploying, monitoring, governing, and maintaining large language models and applications built with them.

How it is used
Guides the transition of generative AI applications from proof of concept to reliable, secure production.
How deep it goes
Defines LLMOps, contrasts it with MLOps, and provides a production checklist covering monitoring, scalability, and security.
Examples
Uses enterprise LLM hosting and a production checklist featuring MLflow, Traceloop, and Prompt flow.
What you can do after
Evaluate production readiness using a checklist for scalability, observability, security, and fairness-aware monitoring.

Read how Generative AI in Action explains LLMOps →

Financial AI in Practice

LLMOps is the set of practices for developing, deploying, monitoring, and maintaining systems based on large language models.

How it is used
Uses LLMOps to manage fraud-analysis RAG and integrate LLM assistance into human workflows.
How deep it goes
Details ingestion, chunking, embedding management, vector database operations, and retrieval strategies without specifying an implementation.
Examples
Illustrates LLMOps with fraud case summaries and an AI-assisted content moderation workflow.
What you can do after
Evaluate operational requirements for a fraud RAG pipeline and the human oversight surrounding LLM-assisted decisions.

Read how Financial AI in Practice explains LLMOps →

Context Engineering

Operational practices for developing, deploying, monitoring, and maintaining systems based on large language models.

How it is used
Organizes model-centric production responsibilities where an organization controls serving, customization, or gateway behavior.
How deep it goes
Outlines the lifecycle and customization options, including fine-tuning governance, validation, and rollback requirements.
Examples
Uses enterprise support tickets, legal documents, financial reports, and task demonstrations as potential fine-tuning data.
What you can do after
Evaluate operational responsibilities for hosted models versus API consumption and the requirements of fine-tuning.

Read how Context Engineering explains LLMOps →

Machine Learning Platform Engineering

LLMOps is the set of engineering and operational practices for developing, deploying, monitoring, and managing large language model applications.

How it is used
Extends MLOps practices to develop, deploy, monitor, secure, and manage production LLM applications.
How deep it goes
Explains architecture and operational concerns through RAG systems, while deferring incident response, compliance, scaling, drift, and business metrics.
Examples
Uses DakkaBot, a RAG-powered documentation assistant, plus document ingestion, semantic search, prompt management, and specialized testing.
What you can do after
Build and operate production-ready RAG applications by extending existing ML platforms with LLM-specific retrieval, prompting, testing, and safety components.

Read how Machine Learning Platform Engineering explains LLMOps →

The Art of AI Product Development

LLMOps is the set of operational practices and automation specialized for deploying, monitoring, maintaining, and updating large language model systems.

How it is used
Structures language-model deployment and improvement as an automated lifecycle of monitoring, evaluation, error analysis, and updates.
How deep it goes
Details prompt versioning, rollback, evaluation, compression, and tuning, but does not provide implementation code or operational runbooks.
Examples
Uses prompt version control, graphical collaboration tools, prompt compression, automated tuning, and custom evaluation metrics.
What you can do after
Operate language-model workflows by automating monitoring, evaluation, error tracking, prompt management, and model updates.

Read how The Art of AI Product Development explains LLMOps →

Building Reliable AI Systems

LLMOps is the engineering discipline of managing large language models in production, including their deployment, evaluation, and ongoing operation.

How it is used
Manages LLM systems in production when staging success does not guarantee reliable behavior at scale.
How deep it goes
Outlines five architecture layers, deployment trade-offs, monitoring metrics, and quality-assurance practices.
Examples
Uses a support chatbot with unpredictable results and a $47,000 monthly bill to illustrate production risks.
What you can do after
Evaluate and understand production readiness through deployment trade-offs, quality signals, cost monitoring, and continuous evaluation.

Read how Building Reliable AI Systems explains LLMOps →

LLMs in Production

LLMOps is the discipline of developing, deploying, monitoring, and maintaining applications and systems built around large language models.

How it is used
Organizes the reliable deployment and maintenance of large-language-model systems at production scale.
How deep it goes
Extends MLOps foundations into compression, parallelism, and retrieval infrastructure, while emphasizing that scale introduces additional caveats.
Examples
Uses quantization, pruning, knowledge distillation, three-way parallelism, and vector-database embedding retrieval.
What you can do after
Apply compression, parallelism, and retrieval infrastructure when operating LLM workflows beyond basic MLOps capabilities.

Read how LLMs in Production explains LLMOps →

Also covered in

What to know first

Related concepts

Questions about LLMOps

What is LLMOps?

LLMOps is the set of engineering and operational practices for developing, deploying, evaluating, monitoring, and maintaining large language model systems and applications.

Which Manning books explain LLMOps?

Generative AI in Action, Financial AI in Practice, Context Engineering, Machine Learning Platform Engineering, The Art of AI Product Development, Building Reliable AI Systems and LLMs in Production.

What should I know before learning LLMOps?

Manning books that teach LLMOps usually introduce language model, mlops, DevOps and deployment pipeline first.

What is the difference between LLMOps and traditional software operations?

LLMOps is the set of engineering and operational practices for developing, deploying, evaluating, monitoring, and maintaining large language model systems and applications. Traditional software operations are the established practices for deploying, maintaining, and monitoring conventional software systems.

What is LLMOps a kind of?

LLMOps is a kind of mlops. MLOps is the discipline of applying engineering and operational practices to develop, deploy, monitor, maintain, and manage machine-learning systems throughout their life cycle.

What are the parts of LLMOps?

LLMOps includes evaluation.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.