SqueezeAILab/KVQuant

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

432

Stars

48

Forks

40.6

Radar Score

Stable

Momentum

Scoring Breakdown

Impact55.5

Velocity27.7

Health35.0

Growth Metrics

7-Day Stars

+0

30-Day Stars

+0

Acceleration

x

Language

Python

Why it ranks

Modest but positive momentum.

LLM Frameworks · inference engineTop 59% globally