kvcache-ai/ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

19.6k
Stars
1.6k
Forks
76.5
Radar Score
Accelerating
Momentum

Scoring Breakdown

Impact94.1
Velocity65.7
Health63.4

Growth Metrics

7-Day Stars
+38
30-Day Stars
+93
Acceleration
1.75x
Language
Python

Why it ranks

Strong momentum — adoption is accelerating week over week.

LLM Frameworks · inference engineTop 35% globally+38 stars / 7d+93 stars / 30d
View on GitHub