Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
📊 Project Info
- Language
- Python
- Stars
- ⭐ 40,635
- Forks
- 6,713
- Today
- +301
- Ranking
- #3
- Collection
- Overall
- Trending Date
- March 25, 2026
- Last Push
- 3/25/2026
🏷️ Topics
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyvertex-ai
📸 Screenshots
