jy-yuan/KIVI

[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

428
Stars
58
Forks
40.1
Radar Score
Stable
Momentum

Scoring Breakdown

Impact55.2
Velocity26.1
Health35.5

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Python

Why it ranks

Modest but positive momentum.

LLM Frameworks ยท quantizationTop 60% globally
View on GitHub