This chapter covers
- A preview of the voice-enabled AI chat application you will build
- The hardware and software you will need
- An introduction to large language models and speech recognition
- Why running AI locally matters, and how it compares to cloud AI
- Opening a terminal and navigating your computer
This book will teach you how to run a large language model (LLM) on your own computer and build a fully functional voice-enabled AI chat application from scratch. By the end of this book, you will speak naturally into your microphone, see your words transcribed on screen, and receive a streaming AI response, entirely on your Mac. No internet connection required. No subscription fees. To maintain your privacy, your voice data, your conversations, and the AI’s responses never leave your machine.
Why build this application instead of using a hosted chatbot? Because the finished app is a private local assistant you can adapt: a voice note taker for personal ideas, a local study partner, a prototype for workplace tools that cannot send data to external services, or the foundation for a document-aware assistant later in the book. The point is not only the chatbot itself; it is learning how audio input, model inference, and a web interface fit together on a Mac you control.