An OpenAI-compatible API follows enough of OpenAI’s interface conventions for clients built for OpenAI to use it. Spring AI’s OpenAI starter can integrate with these APIs much like it integrates with OpenAI’s REST API. section 1.2
Compatible endpoints appear across several kinds of providers and tools:
- Groq and Google Gemini offer OpenAI-compatible APIs alongside or instead of proprietary APIs. section 1.2
- vLLM and LiteLLM provide tools with mostly OpenAI-compatible APIs. section 1.2
- Ollama offers an OpenAI-compatible option for locally running open-source models. section 1.2
