EricLBuehler/candle-vllm

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

734
Stars
92
Forks
56.6
Radar Score
Rising
Momentum

Scoring Breakdown

Impact62.9
Velocity43.5
Health65.0

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Rust

Why it ranks

Steady growth — consistently collecting stars and contributors.

LLM Frameworks · inference engineTop 29% globally
View on GitHub