liveBook · Manning

Ollama

As explained in Building Distributed Applications that Work

Ollama is software for downloading, running, and serving large language models locally.

Ollama lets applications host large language models locally without relying on another server. Models such as Meta’s Llama can power a .NET chat application. section 5.0 section 5.4

Ollama can run in Docker containers, and Aspire has a community toolkit for hosting it in a distributed application. section 5.4

How Building Distributed Applications that Work covers it

How deep it goes
Describes local hosting, Docker execution, and Aspire toolkit support, but gives no setup or operational steps.
Examples
Uses a locally hosted ChatGPT-style assistant and Meta’s Llama as examples.
What you can do after
Understand how to host an LLM for a .NET chat application using Ollama and Aspire.
How it connects
Connects large language models with Docker, Aspire, Semantic Kernel, and chat-completion applications.

Also explained in

Compare how 8 books explain Ollama →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Building Distributed Applications that Work. The section links point to the parts of the book it draws on.