thu-ml

thu-ml / SageAttention

#8
3,486444+1 todayCuda

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

📊 Project Info

Language
Cuda
Stars
3,486
Forks
444
Today
+1
Ranking
#8
Collection
Language
Trending Date
July 16, 2026
Last Push
1/17/2026

🏷️ Topics

attentioncudaefficient-attentioninference-accelerationllmllm-inframlsysquantizationtritonvideo-generatevideo-generationvit

📸 Screenshots

SageAttention screenshot 1SageAttention screenshot 2SageAttention screenshot 3