vitoplantamura/OnnxStream
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.
2.1k
Stars
99
Forks
0.0
Radar Score
Declining
Momentum
Scoring Breakdown
Impact0.0
Velocity0.0
Health0.0
Growth Metrics
7-Day Stars
+0
30-Day Stars
+0
Acceleration
x
Language
C++