thebasedcapital/ane-infer

Apple Neural Engine (ANE) LLM inference engine — reverse-engineered private APIs, Metal GPU shaders, hybrid ANE+GPU+CPU on Apple Silicon. 32 tok/s matching llama.cpp, 3.6 TFLOPS fused ANE mega-kernels.

22
Stars
4
Forks
24.8
Radar Score
Stable
Momentum

Scoring Breakdown

Impact15.6
Velocity26.5
Health37.4

Growth Metrics

7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Rust

Why it ranks

Modest but positive momentum.

AI Infrastructure · model servingTop 92% globally
View on GitHub