jiahongsigma/Efficient-LLM-Inference-Serving-Systems
Why is LLM inference slow — and how do you make it fast? A hands-on, first-principles course: roofline → KV cache → quantization → parallelism → vLLM/SGLang, with GPU labs on open models.
20
Stars
2
Forks
28.0
Radar Score
Stable
Momentum
Scoring Breakdown
Impact7.1
Velocity33.1
Health54.5
Growth Metrics
7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Python