LLM Bridge provides an OpenAI API-compatible API server with support for multiple providers.
addr
: The address of the API server.provider
: The provider of the API server. Supported providers include openai
, ollama
, vllm
, gemini
, anthropic
, vertexai
and etc.api_key
: The API key for OpenAI. You can grab it from the OpenAI Dashboard.model
: The model to use. Supported all chat completions models like gpt-4.1
, gpt-o4
and etc.api_endpoint
: The endpoint of the Ollama API server. Default is http://localhost:11434
.api_key
: The API key for Google Gemini. You can grab it from the Google Cloud Console.api_endpoint
: The endpoint of the vllm API server. Default is http://localhost:9999/v1
.api_key
: The API key for vllm.model
: The model to use. Supported all chat completions models like deepseek-ai/DeepSeek-R1
, llama3
and etc.api_key
: The API key for Anthropic. You can grab it from the Anthropic Dashboard.model
: The model to use. Supported all chat completions models like claude-3.7-sonnet
, claude-3
and etc.