Local ai
Local AI is artificial-intelligence computation performed by a model on a user's device or other locally controlled infrastructure rather than through a remote service.
Build Applications with Local AI Models on a Mac
Local AI is artificial intelligence whose models or computations run on a user's own device rather than on remote infrastructure.
- How it is used
- Keeps chatbot prompts, responses, and potentially voice input on the user’s device for private application building.
- How deep it goes
- Explains the local data flow and tradeoffs, then extends them to an offline test; does not detail model internals.
- Examples
- Uses a local voice chatbot, an airplane-mode test, and confidential legal drafting as concrete cases.
- What you can do after
- Build it from scratch as a local voice-enabled chatbot using Ollama, MLX Whisper, Python, and Streamlit.
Read how Build Applications with Local AI Models on a Mac explains local ai →
Hugging Face in Action
A local model is a machine learning model executed on the user's own machine rather than accessed through a remote service.
- How it is used
- Supports private-document and structured-data querying without sending content to a hosted model.
- How deep it goes
- Demonstrates model loading, prompt construction, LangChain invocation, and DataFrame queries, but reports imperfect generated responses.
- Examples
- Uses GPT4All for private text and PDF data, then Mistral 7B for questions over famous-people JSON.
- What you can do after
- Build it from scratch with GPT4All and LangChain to query local documents or generate DataFrame statements.
Related concepts
- cloud-based AI servicecontrasts with · A cloud-based AI service provides artificial intelligence capabilities through remotely hosted infrastructure accessed over a network.
- controlhas part · Control is the means or degree of influence over a system’s actions, behavior, processes, or operation.
- costhas part · Cost is the monetary expenditure, computational or other resource consumption, effort, or burden incurred in acquiring, producing, operating, or performing something.
- privacyhas part · Privacy is the protection and controlled handling of information or activities to prevent inappropriate access, collection, use, or disclosure.
- large language modeluses · A large language model is a machine-learning model, typically neural, trained on extensive text data to process and generate language.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.