jiahongsigma/Efficient-LLM-Inference-Serving-Systems

Why is LLM inference slow — and how do you make it fast? A hands-on, first-principles course: roofline → KV cache → quantization → parallelism → vLLM/SGLang, with GPU labs on open models.

20
Stars
2
Forks
28.0
Radar Score
Stable
Momentum

Scoring Breakdown

Impact7.1
Velocity33.1
Health54.5

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Python

Why it ranks

Modest but positive momentum.

LLM Frameworks · inference engineTop 86% globally
View on GitHub