A Datacenter Scale Distributed Inference Serving Framework
📊 Project Info
- Language
- Rust
- Stars
- ⭐ 7,515
- Forks
- 1,349
- Today
- +8
- Ranking
- #8
- Collection
- Language
- Trending Date
- July 17, 2026
- Last Push
- 7/17/2026
🏷️ Topics
diffusiondisaggregated-servingkubernetesllm-inferenceomnirouting-enginerustsglangtensorrt-llmvllm
📸 Screenshots
