aws-samples/sample-genai-on-eks-starter-kit

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ๐Ÿš€ AI Gateway (LiteLLM) ๐Ÿค– LLM Serving (vLLM, SGLang, Ollama) ๐Ÿ“Š Vector Databases, ๐Ÿ” Embedding Models (TEI) ๐Ÿ“ˆ Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

92
Stars
52
Forks
44.3
Radar Score
Rising
Momentum

Scoring Breakdown

Impact38.9
Velocity47.9
Health48.1

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
JavaScript

Why it ranks

Steady growth โ€” consistently collecting stars and contributors.

LLM Frameworks ยท inference engineTop 52% globally
View on GitHub