A Datacenter Scale Distributed Inference Serving Framework
📊 Project Info
- Language
- Rust
- Stars
- ⭐ 7,486
- Forks
- 1,338
- Today
- +12
- Ranking
- #15
- Collection
- Language
- Trending Date
- July 14, 2026
- Last Push
- 7/14/2026
🏷️ Topics
diffusiondisaggregated-servingkubernetesllm-inferenceomnirouting-enginerustsglangtensorrt-llmvllm
📸 Screenshots
