hec-ovi/vllm-awq4-qwen

vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-stream, vision, tool calling, 256K context, OpenAI-compatible, Docker. Matches DGX Spark FP8+DFlash+MTP at a third of the cost. No CUDA.

51
Stars
4
Forks
0.0
Radar Score
Declining
Momentum

Scoring Breakdown

Impact0.0
Velocity0.0
Health0.0

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Python

Why it ranks

Momentum is cooling relative to the rest of the index.

LLM Frameworks ยท quantization
View on GitHub