vllm-project/speculators

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

888
Stars
261
Forks
0.0
Radar Score
Declining
Momentum

Scoring Breakdown

Impact0.0
Velocity0.0
Health0.0

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Python

Why it ranks

Momentum is cooling relative to the rest of the index.

LLM Frameworks ยท inference engine
View on GitHub