liveBook · Manning

What you will learn in AI Agents in Action

Build, orchestrate, and deploy autonomous multi-agent systems

by Micheal Lanham

Chapter by chapter

Chapter 1: Introduction to agents and their world

1.1 Defining agents · 1.2 Understanding the component systems of an agent · 1.3 Examining the rise of the agent era: Why agents? · 1.4 Peeling back the AI interface · 1.5 Navigating the agent landscape · 1.6 Summary

What you learn in chapter 1 →

Chapter 2: Harnessing the power of large language models

2.1 Mastering the OpenAI API · 2.1.1 Connecting to the chat completions model · 2.1.2 Understanding the request and response · 2.2 Exploring open source LLMs with LM Studio · 2.2.1 Installing and running LM Studio · 2.2.2 Serving an LLM locally with LM Studio · 2.3 Prompting LLMs with prompt engineering · 2.3.1 Creating detailed queries · 2.3.2 Adopting personas · 2.3.3 Using delimiters · 2.3.4 Specifying steps · 2.3.5 Providing examples · 2.3.6 Specifying output length · 2.4 Choosing the optimal LLM for your specific needs · 2.5 Exercises · 2.6 Summary

What you learn in chapter 2 →

Chapter 3: Engaging GPT assistants

3.1 Exploring GPT assistants through ChatGPT · 3.2 Building a GPT that can do data science · 3.3 Customizing a GPT and adding custom actions · 3.3.1 Creating an assistant to build an assistant · 3.3.2 Connecting the custom action to an assistant · 3.4 Extending an assistant’s knowledge using file uploads · 3.4.1 Building the Calculus Made Easy GPT · 3.4.2 Knowledge search and more with file uploads · 3.5 Publishing your GPT · 3.5.1 Expensive GPT assistants · 3.5.2 Understanding the economics of GPTs · 3.5.3 Releasing the GPT · 3.6 Exercises · 3.7 Summary

What you learn in chapter 3 →

Chapter 4: Exploring multi-agent systems

4.1 Introducing multi-agent systems with AutoGen Studio · 4.1.1 Installing and using AutoGen Studio · 4.1.2 Adding skills in AutoGen Studio · 4.2 Exploring AutoGen · 4.2.1 Installing and consuming AutoGen · 4.2.2 Enhancing code output with agent critics · 4.2.3 Understanding the AutoGen cache · 4.3 Group chat with agents and AutoGen · 4.4 Building an agent crew with CrewAI · 4.4.1 Creating a jokester crew of CrewAI agents · 4.4.2 Observing agents working with AgentOps · 4.5 Revisiting coding agents with CrewAI · 4.6 Exercises · 4.7 Summary

What you learn in chapter 4 →

Chapter 5: Empowering agents with actions

5.1 Defining agent actions · 5.2 Executing OpenAI functions · 5.2.1 Adding functions to LLM API calls · 5.2.2 Actioning function calls · 5.3 Introducing Semantic Kernel · 5.3.1 Getting started with SK semantic functions · 5.3.2 Semantic functions and context variables · 5.4 Synergizing semantic and native functions · 5.4.1 Creating and registering a semantic skill/plugin · 5.4.2 Applying native functions · 5.4.3 Embedding native functions within semantic functions · 5.5 Semantic Kernel as an interactive service agent · 5.5.1 Building a semantic GPT interface · 5.5.2 Testing semantic services · 5.5.3 Interactive chat with the semantic service layer · 5.6 Thinking semantically when writing semantic services · 5.7 Exercises · 5.8 Summary

What you learn in chapter 5 →

Chapter 6: Building autonomous assistants

6.1 Introducing behavior trees · 6.1.1 Understanding behavior tree execution · 6.1.2 Deciding on behavior trees · 6.1.3 Running behavior trees with Python and py_trees · 6.2 Exploring the GPT Assistants Playground · 6.2.1 Installing and running the Playground · 6.2.2 Using and building custom actions · 6.2.3 Installing the assistants database · 6.2.4 Getting an assistant to run code locally · 6.2.5 Investigating the assistant process through logs · 6.3 Introducing agentic behavior trees · 6.3.1 Managing assistants with assistants · 6.3.2 Building a coding challenge ABT · 6.3.3 Conversational AI systems vs. other methods · 6.3.4 Posting YouTube videos to X · 6.3.5 Required X setup · 6.4 Building conversational autonomous multi-agents · 6.5 Building ABTs with back chaining · 6.6 Exercises · 6.7 Summary

What you learn in chapter 6 →

Chapter 7: Assembling and using an agent platform

7.1 Introducing Nexus, not just another agent platform · 7.1.1 Running Nexus · 7.1.2 Developing Nexus · 7.2 Introducing Streamlit for chat application development · 7.2.1 Building a Streamlit chat application · 7.2.2 Creating a streaming chat application · 7.3 Developing profiles and personas for agents · 7.4 Powering the agent and understanding the agent engine · 7.5 Giving an agent actions and tools · 7.6 Exercises · 7.7 Summary

What you learn in chapter 7 →

Chapter 8: Understanding agent memory and knowledge

8.1 Understanding retrieval in AI applications · 8.2 The basics of retrieval augmented generation (RAG) · 8.3 Delving into semantic search and document indexing · 8.3.1 Applying vector similarity search · 8.3.2 Vector databases and similarity search · 8.3.3 Demystifying document embeddings · 8.3.4 Querying document embeddings from Chroma · 8.4 Constructing RAG with LangChain · 8.4.1 Splitting and loading documents with LangChain · 8.4.2 Splitting documents by token with LangChain · 8.5 Applying RAG to building agent knowledge · 8.6 Implementing memory in agentic systems · 8.6.1 Consuming memory stores in Nexus · 8.6.2 Semantic memory and applications to semantic, episodic, and procedural memory · 8.7 Understanding memory and knowledge compression · 8.8 Exercises · 8.9 Summary

What you learn in chapter 8 →

Chapter 9: Mastering agent prompts with prompt flow

9.1 Why we need systematic prompt engineering · 9.2 Understanding agent profiles and personas · 9.3 Setting up your first prompt flow · 9.3.1 Getting started · 9.3.2 Creating profiles with Jinja2 templates · 9.3.3 Deploying a prompt flow API · 9.4 Evaluating profiles: Rubrics and grounding · 9.5 Understanding rubrics and grounding · 9.6 Grounding evaluation with an LLM profile · 9.7 Comparing profiles: Getting the perfect profile · 9.7.1 Parsing the LLM evaluation output · 9.7.2 Running batch processing in prompt flow · 9.7.3 Creating an evaluation flow for grounding · 9.7.4 Exercises · 9.8 Summary

What you learn in chapter 9 →

Chapter 10: Agent reasoning and evaluation

10.1 Understanding direct solution prompting · 10.1.1 Question-and-answer prompting · 10.1.2 Implementing few-shot prompting · 10.1.3 Extracting generalities with zero-shot prompting · 10.2 Reasoning in prompt engineering · 10.2.1 Chain of thought prompting · 10.2.2 Zero-shot CoT prompting · 10.2.3 Step by step with prompt chaining · 10.3 Employing evaluation for consistent solutions · 10.3.1 Evaluating self-consistency prompting · 10.3.2 Evaluating tree of thought prompting · 10.4 Exercises · 10.5 Summary

What you learn in chapter 10 →

Chapter 11: Agent planning and feedback

11.1 Planning: The essential tool for all agents/assistants · 11.2 Understanding the sequential planning process · 11.3 Building a sequential planner · 11.4 Reviewing a stepwise planner: OpenAI Strawberry · 11.5 Applying planning, reasoning, evaluation, and feedback to assistant and agentic systems · 11.5.1 Application of assistant/agentic planning · 11.5.2 Application of assistant/agentic reasoning · 11.5.3 Application of evaluation to agentic systems · 11.5.4 Application of feedback to agentic/assistant applications · 11.6 Exercises · 11.7 Summary

What you learn in chapter 11 →

Concepts explained in this book

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.