chapter one

1 Getting Started with Local AI

 

This chapter covers

  • A preview of the voice-enabled AI chat application you will build
  • The hardware and software you need
  • An introduction to large language models and speech recognition
  • Why running AI locally matters — and how it compares to cloud AI
  • Opening the terminal and navigating your computer with it

This book teaches you how to run a large language model (LLM) on your own computer and build a fully functional voice-enabled AI chat application -- from scratch. By the end of this book, you will speak naturally into your microphone, watch your words transcribed on screen, and receive a streaming AI response -- entirely on your Mac. No internet connection required. No subscription fees. To maintain your privacy, your voice data, your conversations, and the AI's responses never leave your machine.

Why build this instead of just using a hosted chatbot? Because the finished app is a private local assistant you can adapt: a voice note taker for personal ideas, a local study partner, a prototype for workplace tools that cannot send data to external services, or the foundation for a document-aware assistant later in the book. The point is not only the chatbot itself; it is learning how audio input, model inference, and a web interface fit together on a Mac you control.

1.1 Why Run AI Locally?

1.1.1 Cloud AI vs. Local AI

1.1.2 When to Use Cloud AI vs. Local AI

1.2 The Local Chat Application You Will Build

1.3 What You Will Need

1.4 What Is a Large Language Model?

1.5 Using the Terminal to Interact with Your Computer

1.5.1 Two Ways to Talk to Your Computer

1.5.2 CLI vs. GUI: A Comparison

1.5.3 Why Use the Command Line?

1.6 Opening the Terminal on macOS

1.6.1 Method 1: Spotlight Search (Recommended)

1.6.2 Method 2: Applications Folder

1.6.3 Customizing the Appearance

1.7 Essential Commands

1.7.1 Command 1: `pwd` -- Where Am I?

1.7.2 Command 2: `ls` -- What Is Here?

1.7.3 Command 3: `cd` -- Moving Around

1.7.4 Bonus: `clear` -- A Fresh Start

1.7.5 Command 4: `mkdir` -- Creating Folders

1.7.6 What Happens When You Type a Command

1.7.7 Common Fears and Realities

1.8 Summary

1.9 Exercises