vllm-project / semantic-router

#12

4,970754+18 todayGo

View on GitHub

Intelligent Mixture-of-Models Router for Efficient Heterogeneous LLMs Inference

📊 Project Info

Language: Go
Stars: ⭐ 4,970
Forks: 754
Today: +18
Ranking: #12
Collection: Language
Trending Date: July 14, 2026
Last Push: 7/14/2026

🏷️ Topics

ai-gatewaybert-classificationfine-tuninggolanghuggingface-candlehuggingface-transformerskubernetesllmllmroutermcpmixture-of-modelsopenclawpii-detectionprompt-engineeringprompt-guardrustsemantic-routervllm

📸 Screenshots