Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
📊 Project Info
- Language
- Go
- Stars
- ⭐ 5,286
- Forks
- 643
- Today
- +42
- Ranking
- #13
- Collection
- Language
- Trending Date
- May 27, 2026
- Last Push
- 5/27/2026
🏷️ Topics
ai-gatewaygatewaygateway-servicesgenerative-aiguardrailsllmllm-costllm-gatewayllm-observabilityllmopsload-balancingmcp-clientmcp-gatewaymcp-servermodel-routertoken-management
📸 Screenshots
