kyegomez/attn_res
A clean, single-file PyTorch implementation of Attention Residuals (Kimi Team, MoonshotAI, 2026), integrated with Grouped Query Attention (GQA), SwiGLU feed-forward networks, and Rotary Position Embeddings (RoPE).
41
Stars
2
Forks
24.5
Radar Score
Stable
Momentum
Scoring Breakdown
Impact16.8
Velocity23.8
Health37.9
Growth Metrics
7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
Python