NeelM0906/Mference
Swift + Metal MoE inference for Apple Silicon: Qwen 3.6 35B at 23.5–29.3 tok/s decode with 2.20× faster long-prompt prefill on a 24 GB M5; Gemma 4 26B in ~2 GB, DeepSeek-V4-Flash 284B, Inkling-Small 276B, native Mac app, CLI, and OpenAI-compatible server.
122
Stars
15
Forks
0.0
Radar Score
Declining
Momentum
Scoring Breakdown
Impact0.0
Velocity0.0
Health0.0
Growth Metrics
7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Swift