shtjww/llm-inference-capacity-handbook

大模型推理案头手册(开源版):给定 GPU 算力,一个模型能扛多少 QPS?三层模型 × 三面墙 × 排队论 × 开环压测

202
Stars
0
Forks
0.0
Radar Score
Declining
Momentum

Scoring Breakdown

Impact0.0
Velocity0.0
Health0.0

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
—

Why it ranks

Momentum is cooling relative to the rest of the index.

AI Infrastructure · model serving
View on GitHub