thushan/olla
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
319
Stars
56
Forks
47.6
Radar Score
Stable
Momentum
Scoring Breakdown
Impact48.0
Velocity39.4
Health58.8
Growth Metrics
7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Go
Why it ranks
Steady growth — consistently collecting stars and contributors.
LLM Frameworks · inference engineTop 45% globally