A high-throughput and memory-efficient inference and serving engine for LLMs
Stars and forks are a snapshot taken when this directory was last refreshed, not a live count — the figure here matches the one in our articles and videos. Last refreshed 5 Sept 2026.