alibaba

alibaba / rtp-llm

#1
1,178204+8 todayCuda

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

📊 Project Info

Language
Cuda
Stars
1,178
Forks
204
Today
+8
Ranking
#1
Collection
Language
Trending Date
June 3, 2026
Last Push
6/3/2026

🏷️ Topics

gptinferencellamallmllm-servingllmopsmodel-serving

📸 Screenshots

rtp-llm screenshot 1