Managed API
A managed API is an interface to a service whose provider operates the underlying software and infrastructure, typically accessed over a network.
LLM Customization and Fine-Tuning
A provider-operated model interface accessed through an API rather than self-hosted by the user.
- How it is used
- Frames managed APIs as the buy option before deciding whether to train or self-host a model.
- How deep it goes
- Explains selection criteria, operational responsibilities, and an SDK call, stopping short of a detailed vendor selection procedure.
- Examples
- Uses an Anthropic Python SDK call that asks a hosted model to distinguish stocks from bonds.
- What you can do after
- Evaluate whether a managed API or self-hosting better fits privacy, customization, traffic, and operational constraints.
Read how LLM Customization and Fine-Tuning explains managed API →
Building Reliable AI Systems
A hosted API is an application programming interface provided by an external service whose infrastructure runs the underlying model or software.
- How it is used
- Supports rapid access to hosted models when prototyping or deploying an application with limited infrastructure management.
- How deep it goes
- Compares setup advantages, token-cost exposure, and outage stakes when choosing where to run a model.
- Examples
- Uses a customer-support chatbot interaction and an OpenAI Python request as concrete examples.
- What you can do after
- Apply it via the OpenAI Python client to send a chat-completion request and print the returned response.
Read how Building Reliable AI Systems explains managed API →
Also covered in
- Self-Hosting LLMs at ScaleIn early access (MEAP)
What to know first
- latencyLatency is the elapsed time between initiating an operation or request and receiving its corresponding result or observable response.
- privacyPrivacy is the protection of information about people or other sensitive subjects from inappropriate collection, access, use, or disclosure, including control over how it is handled.
- tokenA token is a discrete unit of text, such as a word, subword, punctuation mark, or symbol, produced by tokenization and processed by a language model.
Related concepts
- endpointuses · An endpoint is an addressable interface of a service through which clients access a resource or invoke an operation, typically via a network request.
- self-hostingcontrasts with · Self-hosting is deploying and operating software on infrastructure controlled or managed by the person or organization using it.
- open-source modelalternative to · An open-source model is a machine-learning model whose relevant artifacts, such as code or weights, are made available under terms permitting specified forms of access, use, modification, or redistribution.
Questions about managed API
What is managed API?
A managed API is an interface to a service whose provider operates the underlying software and infrastructure, typically accessed over a network.
Which Manning books explain managed API?
LLM Customization and Fine-Tuning and Building Reliable AI Systems.
What should I know before learning managed API?
Manning books that teach managed API usually introduce latency, privacy and token first.
What is the difference between managed API and self-hosting?
A managed API is an interface to a service whose provider operates the underlying software and infrastructure, typically accessed over a network. Self-hosting is deploying and operating software on infrastructure controlled or managed by the person or organization using it.
What is managed API also called?
Managed API is also called hosted api.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.

