0xBakeer/Qwen3.8-27B-4-bit-on-a-single-DGX-Spark

Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedInt4-AutoRound vs the FP8 baseline, measured on one harness — including why the quantization advantage collapses to +0.2% by c16.

51
Stars
4
Forks
0.0
Radar Score
Declining
Momentum

Scoring Breakdown

Impact0.0
Velocity0.0
Health0.0

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Python

Why it ranks

Momentum is cooling relative to the rest of the index.

LLM Frameworks · quantization
View on GitHub