atomicmilkshake/llama-cpp-turboquant

llama.cpp fork with TurboQuant quantization (turbo2/3/4) and TriAttention GPU-accelerated KV cache pruning. 75 tok/s on Qwen3-8B / RTX 3080.

55
Stars
11
Forks
30.5
Radar Score
Stable
Momentum

Scoring Breakdown

Impact19.1
Velocity30.1
Health49.2

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
C++

Why it ranks

Modest but positive momentum.

AI Infrastructure ยท gpu managementTop 81% globally
View on GitHub