liveBook · Manning

Local ai

Local AI is artificial-intelligence computation performed by a model on a user's device or other locally controlled infrastructure rather than through a remote service.

How 2 Manning books explain it

Build Applications with Local AI Models on a Mac

Local AI is artificial intelligence whose models or computations run on a user's own device rather than on remote infrastructure.

How it is used
Uses local AI as the foundation for a private, offline voice-enabled chatbot.
How deep it goes
Explains data flow and cloud tradeoffs, then verifies offline inference with an airplane mode test.
Examples
Uses a local chatbot, confidential legal drafting, and private creative brainstorming as examples.
What you can do after
Apply it via Ollama to run local models and build a voice-enabled chatbot.

Read how Build Applications with Local AI Models on a Mac explains local ai →

Hugging Face in Action

A local model is a machine learning model executed on the user's own machine rather than accessed through a remote service.

How it is used
Supports private-document and structured-data querying without sending content to a hosted model.
How deep it goes
Demonstrates model loading, prompt construction, LangChain invocation, and DataFrame queries, but reports imperfect generated responses.
Examples
Uses GPT4All for private text and PDF data, then Mistral 7B for questions over famous-people JSON.
What you can do after
Build it from scratch with GPT4All and LangChain to query local documents or generate DataFrame statements.

Read how Hugging Face in Action explains local ai →

Also covered in

What to know first

Related concepts

Questions about local ai

What is local ai?

Local AI is artificial-intelligence computation performed by a model on a user's device or other locally controlled infrastructure rather than through a remote service.

Which Manning books explain local ai?

Build Applications with Local AI Models on a Mac and Hugging Face in Action.

What should I know before learning local ai?

Manning books that teach local ai usually introduce language model and privacy first.

What is the difference between local ai and cloud-based AI service?

Local AI is artificial-intelligence computation performed by a model on a user's device or other locally controlled infrastructure rather than through a remote service. A cloud-based AI service provides artificial intelligence capabilities through remotely hosted infrastructure accessed over a network.

What are the parts of local ai?

Local ai includes cost, control and privacy.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.