BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

61.4k
Stars
12.4k
Forks
79.2
Radar Score
Rising
Momentum

Star History

Sep 15 → Oct 8
58.8k ★+1.5k in period60.3k ★

Radar Score History

Aug 21 → Oct 8
80.0now 79.1

Scoring Breakdown

Impact98.5
Velocity70.2
Health60.8

Growth Metrics

7-Day Stars
+770
30-Day Stars
+1.8k
Acceleration
1.32x
Language
Python

Why it ranks

Exceptional momentum — gaining stars far faster than almost everything else tracked.

LLM Frameworks · servingTop 8% globally+770 stars / 7d+1.8k stars / 30d
View on GitHub