weicj/vLLM-2080Ti-Definitive
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )
1.2k
Stars
157
Forks
62.5
Radar Score
Rising
Momentum
Scoring Breakdown
Impact60.7
Velocity62.8
Health65.0
Growth Metrics
7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Python
Why it ranks
Strong momentum — adoption is accelerating week over week.
Local AI · local runnerTop 20% globally