hanxiao/Qwen3.6-35B-A3B-MTP-L4

Deploy Qwen3.6-35B-A3B (Q4_K_XL) + MTP speculative decoding on a single NVIDIA L4 24GB — GCP g2-standard-8 — via the official llama.cpp Docker image. Decode-optimized to ~91–99 tok/s (min ~91 chat, max ~99 math), lossless (full GPU residency + ECC-off).

16
Stars
2
Forks
27.2
Radar Score
Stable
Momentum

Scoring Breakdown

Impact5.1
Velocity33.0
Health54.5

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Shell

Why it ranks

Modest but positive momentum.

AI Infrastructure · model servingTop 88% globally
View on GitHub