Sandermage/sndr_core_engine

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash spec-decode, FULL cudagraph, hybrid GDN. vLLM pin dev424 + Control Center GUI.

133
Stars
5
Forks
42.4
Radar Score
Rising
Momentum

Scoring Breakdown

Impact33.5
Velocity41.0
Health58.9

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Python

Why it ranks

Steady growth — consistently collecting stars and contributors.

LLM Frameworks · inference engineTop 56% globally
View on GitHub