The open-source AI projects that matter right now — stars, licence and what each one does.
2 repositories
A high-throughput and memory-efficient inference and serving engine for LLMs
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Star counts are a snapshot, not a live feed — they are refreshed when the directory is updated, so the number here matches the one in our articles and videos.