Ollama lets applications host large language models locally without relying on another server. Models such as Meta’s Llama can power a .NET chat application. section 5.0 section 5.4
Ollama can run in Docker containers, and Aspire has a community toolkit for hosting it in a distributed application. section 5.4







