azrtydxb/Fastllm-proxy

The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.

106
Stars
91
Forks
57.4
Radar Score
Rising
Momentum

Scoring Breakdown

Impact34.6
Velocity80.1
Health62.0

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Rust

Why it ranks

Exceptional momentum — gaining stars far faster than almost everything else tracked.

LLM Frameworks · servingTop 28% globally
View on GitHub