LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
📊 Project Info
- Language
- Python
- Stars
- ⭐ 13,268
- Forks
- 1,135
- Today
- +185
- Ranking
- #6
- Collection
- Overall
- Trending Date
- May 10, 2026
- Last Push
- 5/9/2026
🏷️ Topics
apple-siliconinference-serverllmmacosmlxopenai-api
📸 Screenshots
