Local AI

FlashML-org/FreeToken

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

ollama/ollama

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

louislam/uptime-kuma

A fancy self-hosted monitoring tool

open-webui/open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

immich-app/immich

High performance self-hosted photo and video management solution.

google-ai-edge/gallery

A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.

topoteretes/cognee

Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory with small models for free

odysseus-dev/odysseus

Self-hosted AI workspace.

TencentCloud/Octop

A smarter, self-hosted AI assistant — multi-user, multi-agent.

janhq/jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

ml-explore/mlx

MLX: An array framework for Apple silicon

ggml-org/whisper.cpp

Port of OpenAI's Whisper model in C/C++

LizardByte/Sunshine

Self-hosted game stream host for Moonlight.

oblien/openship

Self-hosted deployment platform

DuarteSantos8/openGym

Self-hosted gym & body-weight tracker — plan routines, log workouts (supersets, warm-ups, cardio), see which muscles are trained, fatigued or detrained, import from FitNotes/Strong/Hevy, passkey login

mastodon/mastodon

Your self-hosted, globally interconnected microblogging community

juanfont/headscale

An open source, self-hosted implementation of the Tailscale control server

AlexsJones/llmfit

Hundreds of models & providers. One command to find what runs on your hardware.

exo-explore/exo

Run frontier AI locally.

rmyndharis/OpenWA

Free, Open Source, Self-Hosted WhatsApp API Gateway

usememos/memos

Open-source, self-hosted note-taking tool built for quick capture. Markdown-native, lightweight, and fully yours.

kubernetes/minikube

Run Kubernetes locally

antirez/ds4

DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm

supermemoryai/supermemory

Memory and context engine + app that is extremely fast, scalable, and can be run fully locally. The Memory API for the AI era.

langbot-app/LangBot

Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integr

iflytek/skillhub

Self-hosted, open-source agent skill registry for enterprises. Publish & version skill packages, govern with RBAC and audit logs, deploy on-premise with Docker or Kubernetes.

glanceapp/glance

A self-hosted dashboard that puts all your feeds in one place

C4illin/ConvertX

💾 Self-hosted online file converter. Supports 1000+ formats ⚙️

feder-cr/invisible_dots

Open-source, self-hosted alternative to OpenAI Dots, Grok Bot. Built to be undetectable by anti-bot systems.

siyuan-note/siyuan

An open-source, privacy-first, self-hosted knowledge workspace where humans and AI agents work together 开源、隐私优先、自托管的知识工作空间，让人与智能体在此协作

srbhr/Resume-Matcher

The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.

ml-explore/mlx-lm

Run LLMs with MLX

knadh/listmonk

High performance, self-hosted, newsletter and mailing list manager with a modern dashboard. Single binary app.

qualcomm/GenieX

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

ollama/ollama-python

Ollama Python library

alibaba/MNN

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

LibreTranslate/LibreTranslate

Free and Open Source Machine Translation API. Self-hosted, offline capable and easy to setup.

traccar/traccar

Open source GPS tracking platform - self-hosted or managed, 200+ device protocols

Termix-SSH/Termix

Self-hosted, plugin-based server management.

rommapp/romm

A beautiful, powerful, self-hosted ROM manager and player.

LearningCircuit/local-deep-research

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encry

dagger/dagger

Automation engine to build, test and ship any codebase. Runs locally, in CI, or directly in the cloud

Blaizzy/mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

plausible/analytics

Open source, privacy-first web analytics. Lightweight, cookie-free Google Analytics alternative. Self-hosted or cloud.

ArvinLovegood/go-stock

🦄🦄🦄AI赋能股票分析：AI加持的股票分析/选股工具。股票行情获取，AI热点资讯分析，AI资金/财务分析，涨跌报警推送。支持A股，港股，美股。支持市场整体/个股情绪分析，AI辅助选股等。数据全部保留在本地。支持DeepSeek，OpenAI， Ollama，LMStudio，AnythingLLM，硅基流动，火山方舟，阿里云百炼等平台或模型。

Zackriya-Solutions/meetily

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (

raullenchai/Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than

grimmory-tools/grimmory

A self-hosted library for your ebooks, comics, and audiobooks

maziyarpanahi/openmed

Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Ap

n4ze3m/page-assist

Use your locally running AI models to assist you in your web browsing

RunanywhereAI/runanywhere-sdks

Production ready toolkit to run AI locally

smol-machines/smolvm

An embeddable, portable, branchable virtual machine to safely run Agents locally.

jeffvli/feishin

A modern self-hosted music player.

btcpayserver/btcpayserver

Accept Bitcoin payments. Free, open-source & self-hosted, Bitcoin payment processor.

getsentry/self-hosted

Sentry, feature-complete and packaged up for low-volume deployments and proofs-of-concept

apple/coreai-models

Model export recipes, Python primitives, and Swift runtime utilities for on-device AI

cloudreve/cloudreve

🌩 Self-hosted file management and sharing system, supports multiple storage providers

supertone-inc/supertonic

Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.

mizorewww/laya-mlx

Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.

octobercms/october

Self-hosted CMS platform based on the Laravel PHP Framework.

teslamate-org/teslamate

A self-hosted data logger for your Tesla 🚘 [main maintainer=@JakobLichterfeld]

seakee/CPA-Manager-Plus

A self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health.

argmaxinc/argmax-oss-swift

On-device Speech AI for Apple Silicon

actions/actions-runner-controller

Kubernetes controller for GitHub Actions self-hosted runners

nezhahq/nezha

:trollface: Self-hosted, lightweight server and website monitoring and O&M tool

advplyr/audiobookshelf

Self-hosted audiobook and podcast server

securo-finance/securo

Open-source personal finance manager. Self-hosted, privacy-first.

n8n-io/self-hosted-ai-starter-kit

The Self-hosted AI Starter Kit is an open-source template that quickly sets up a local AI environment. Curated by n8n, it provides essential tools for creating secure, self-hosted AI workflows.

averygan/reclip

Download videos from almost any website. Lightweight, self-hosted media downloader with a clean web UI.

clusterzx/paperless-ai

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

khoj-ai/khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI

nektos/act

Run your GitHub Actions locally 🚀

niedev/RTranslator

Open source real-time translation app for Android that runs locally

LibrePhotos/librephotos

A self-hosted open source photo management service.

pytorch/executorch

On-device AI across mobile, embedded and edge for PyTorch

alexta69/metube

Self-hosted video downloader for YouTube and other sites (web UI for yt-dlp)

claration/Feather

Free on-device iOS/iPadOS application manager/installer, using certificates part of the Apple Developer Program.

cachethq/cachet

🚦 Cachet, the open source, self-hosted status page system.

vas3k/TaxHacker

Self-hosted AI accounting app. LLM analyzer for receipts, invoices, transactions with custom prompts and categories

Arthur-Ficial/apfel

The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.

mockoon/mockoon

Mockoon is the easiest and quickest way to run mock APIs locally. No remote deployment, no account required, open source.

nicedreamzapp/claude-code-local

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 12

dorssel/usbipd-win

Windows software for sharing locally connected USB devices to other machines, including Hyper-V guests and WSL 2.

InvoicePlane/InvoicePlane

A self-hosted open source application for managing your invoices, clients and payments.

tencentmusic/cube-studio

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，mlops算法链路全流程，算力租赁平台，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU虚拟化，边缘计算，标注平台自动化标注，deepseek等大模型sft微调/奖励模型/强化学习训练，vllm/ollama/mindie大模型多机推理，私有知识库，AI模型市场，支持

thelounge/thelounge

💬 ‎ Modern, responsive, cross-platform, self-hosted web IRC client

Andyyyy64/whichllm

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

denoland/celld

self-hosted, distributed Durable Objects

OpenBMB/MiniCPM

MiniCPM5: SOTA on-device LLMs, small yet powerful.

freescout-help-desk/freescout

FreeScout — Free self-hosted help desk & shared mailbox (Zendesk / Help Scout alternative)

crestalnetwork/intentkit

IntentKit is an open-source, self-hosted cloud agent cluster that manages a collaborative team of AI agents for you.

claration/feather

Free on-device iOS/iPadOS application manager/installer, using certificates part of the Apple Developer Program.

jpillora/cloud-torrent

☁️ Cloud Torrent: a self-hosted remote torrent client

YaoApp/yao

✨ All your agents and workspaces in one place, on every device you own. Track tasks on a board, accessible from desktop, mobile, browser, or API. Self-hosted.

photoview/photoview

Photo gallery for self-hosted personal servers

dherault/serverless-offline

Emulate AWS λ and API Gateway locally when developing your Serverless project

Athou/commafeed

Google Reader inspired self-hosted personal RSS reader.

stringer-rss/stringer

A self-hosted, anti-social RSS reader.

AtomicBot-ai/Atomic-Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

ollama/ollama-js

Ollama JavaScript library

docker/genai-stack

Langchain + Docker + Neo4j + Ollama

siddsachar/row-bot

Row-Bot - Personal AI Sovereignty. A local-first AI assistant with integrated tools, a personal knowledge graph, voice, vision, shell, browser automation, scheduled tasks, health tracking, and messagi

tmoroney/auto-subs

On-device subtitle generation that connects directly to DaVinci Resolve, Premiere, and After Effects.

TypeWhisper/typewhisper-mac

Local speech-to-text for macOS on-device AI, fully private, optional cloud

Paca-AI/paca

AI-native, free, open-source alternative to Jira, Trello, ClickUp & Monday. Built for Scrum teams where humans and AI agents collaborate as equals — on the same board, the same sprints, the same goals

Open-LLM-VTuber/Open-LLM-VTuber

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms

cogwheel0/conduit

Native iOS and Android client for Open WebUI, direct OpenAI-compatible, Ollama, and Hermes agents.

neuphonic/neutts

On-device TTS model by Neuphonic

open-wanderer/wanderer

wanderer is a self-hosted trail database. Save your adventures!

claraverse-space/ClaraVerse

Claraverse is a opesource privacy focused ecosystem to replace ChatGPT, Claude, N8N, ImageGen with your own hosted llm, keys and compute. With desktop, IOS, Android Apps.

Anil-matcha/open-dots

Open-source, self-hosted AI agent workspace and alternative to OpenAI Dots, Meta Muse, Grok Bot, Instinct, Manus Cue, Claude Cowork, and ChatGPT agent. MIT-licensed; includes chat, connectors, approva

vitodeploy/vito

Free and Self-Hosted Server Management Tool

weicj/vLLM-2080Ti-Definitive

The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://dis

ml-explore/mlx-examples

Examples in the MLX framework

soniqo/speech-swift

AI speech toolkit for Apple Silicon — ASR, TTS, speech-to-speech, VAD, and diarization powered by MLX and CoreML

hydropix/TranslateBooksWithLLMs

Translate full-length books and documents with Ollama, OpenAI-compatible, Gemini, Mistral, DeepSeek, Poe or OpenRouter. Preserves formatting. Resumes where you left off. No file size limits.

silverstein/minutes

Open-source, local-first Granola/Otter alternative that Claude Code, Codex, Cursor, and any MCP client can query. Meetings, calls, and voice memos transcribed on-device into markdown you own.

meizhong986/WhisperJAV

ASR/STT subtitle generator. Uses Qwen3-ASR, local LLM, Whisper, TEN-VAD. Noise-robust for JAV

kubewall/kubewall

kubewall - Single-Binary Kubernetes Dashboard with Multi-Cluster Management & AI Integration. (OpenAI / Claude 4 / Gemini / DeepSeek / OpenRouter / Ollama / Qwen / LMStudio)

qualcomm/ai-hub-models

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

stoatchat/self-hosted

Deploy Stoat on your own infrastructure!

jjang-ai/mlxstudio

MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.

nikmcfly/MiroFish-Offline

Offline multi-agent simulation & prediction engine. English fork of MiroFish with Neo4j + Ollama local stack.

shlinkio/shlink

The definitive self-hosted URL shortener

nico-martin/gemma4-browser-extension

On-device AI agent Chrome extension powered by Transformers.js and Gemma 4

tastyeffectco/sandboxd

Open-source, self-hosted AI app builder — an agent builds real apps in isolated sandboxes on your own server, each live at a preview URL. Self-host in one command. MIT.

chunkhound/chunkhound

Local first codebase intelligence

OwO-Network/DLX

DLX - Self-hosted translation API server. Unofficial; not affiliated with DeepL SE.

leonickson1/Swiftlet

Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM,

gluonfield/enchanted

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

JHubi1/ollama-app

A modern and easy-to-use client for Ollama

withcatai/node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Picovoice/porcupine

On-device wake word detection powered by deep learning

harry0703/AudioNotes

快速提取音视频内容，整理成一份结构化的markdown笔记

bugsink/bugsink

Self-hosted Error Tracking

lss233/kirara-ai

🤖 可 DIY 的 多模态 AI 聊天机器人 | 🚀 快速接入 微信、 QQ、Telegram、等聊天平台 | 🦈支持DeepSeek、Grok、Claude、Ollama、Gemini、OpenAI | 工作流系统、网页搜索、AI画图、人设调教、虚拟女仆、语音对话 |

rusq/slackdump

Save or export your private and public Slack messages, threads, files, and users locally without admin privileges.

offen/docker-volume-backup

Backup Docker volumes locally or to any S3, WebDAV, Azure Blob Storage, Dropbox, Google Drive or SSH compatible storage

ddalcu/mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

kittendevv/Invio

Self-hosted invoicing without the bloat.

K-Dense-AI/k-dense-byok

An AI co-scientist running on your desktop. Claude Science but better.

ClaudioDrews/memory-os

A 7-layer memory operating system for Hermes Agent — persistent memory with Qdrant, structured facts, fabric recall, auto-curated wiki, and surgical context injection. Runs locally, any LLM provider.

ModalityDance/PalmClaw

[EMNLP 2026 Demo] "PalmClaw: A Native On-Device Agent Framework for Mobile Phones"

Woolverine94/biniou

a self-hosted webui for 30+ generative ai

vinta/pangu.js

Opinionated paranoid text spacing in JavaScript, with on-device AI semantic judgment

nobodywho-ooo/nobodywho

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

SudoHopeX/KaliGPT

KaliGPT: an Agentic AI (built with Gemini, ChatGPT, Ollama, OpenRouter Models) fine tuned for ethical hackers & students in offensive security making workflows smarter, faster, and more accessible.

Pangu-Immortal/MagicWX

Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments.

bitwarden/self-host

Bitwarden's self-hosted release repository

0x2E/fusion

A lightweight, self-hosted friendly RSS reader

kellyvv/PhoneClaw

PhoneClaw turns phones into local AI agent runtimes with on-device models, native mobile Skills, LiveLand, and optional Mac Gateway inference.

Mobile-Artificial-Intelligence/maid

Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.

agentrq/agentrq

AgentRQ: Human-in-loop realtime conversational task manager for AI Agents. Self-hosted! Control your own agents from wherever you want Mobile, Web, Desktop. Designed to work well with your own Claude

ardanlabs/kronk

Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a hig

rishikanthc/Scriberr

Self-hosted AI audio transcription

pguso/agents-from-scratch

Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning.

sourcegraph/checkup

Distributed, lock-free, self-hosted health checks and status pages

openyak/openyak

Open-source local-first AI agent for desktop work. No account, no telemetry: use local models with Ollama/Rapid-MLX or bring your own provider key.

sarim2000/pennywiseai-tracker

PennyWise automatically reads transaction SMS messages and transforms them into organized financial data with on-device AI assistance. No manual entry, no cloud processing, complete privacy.

Anil-matcha/awesome-openclaw

A curated list of OpenClaw resources, tools, skills, tutorials & articles. OpenClaw (formerly Moltbot / Clawdbot) — open-source self-hosted AI agent for WhatsApp, Telegram, Discord & 50+ integrations.

jofizcd/Soul-of-Waifu

🌌 Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app featuring Live2D/VRM avatars, voice chat & local LLM. Evolve together across immersive chat, RPG adven

devoxx/DevoxxGenieIDEAPlugin

DevoxxGenie is an agentic plugin for IntelliJ IDEA that uses local LLM's (Ollama, LMStudio, GPT4All, Jan and Llama.cpp) and Cloud based LLMs to help review, test, explain your project code. Latest ver

EthanYoQ/AI-Novel-Writer

AI 小说创作软件：把灵感、角色、世界观、大纲、章节写作、审稿和修稿组织成可控流程；提供 Windows/macOS 桌面版，支持本地和在线模型。AI Novel Writing Software: Organizes inspirations, characters, worldbuilding, outlines, chapter drafting, review, and revision

control-theory/gonzo

Gonzo! The Go based TUI log analysis tool

HelgeSverre/ollama-gui

A Web Interface for chatting with your local LLMs via the ollama API

FrigadeHQ/yap

Free, open source voice dictation for macOS. On-device transcription with Apple's Speech framework. No cloud/no API keys/no account.

kossakovsky/selfhost-ai

One-command installer for a self-hosted AI stack on your own server: n8n, Ollama, Open WebUI, OpenClaw, Dify, Flowise, Supabase, ComfyUI, Qdrant & 30+ tools. Docker Compose, automatic HTTPS via Caddy,

agents-io/PokeClaw

PokeClaw (PocketClaw) — first on-device AI that controls your Android phone. Gemma 4, no cloud, no API key. Poke is short for Pocket.

traggo/server

self-hosted tag-based time tracking

malaohu/forsaken-mail

a self-hosted disposable mail service

jaylfc/taOS

Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full

bkywksj/knowledge-base

本地优先的知识库桌面应用。Markdown 编辑器 + 全文搜索（FTS5） + 双向链接 / 知识图谱；多端同步（WebDAV / S3 / 同步盘，单笔记粒度增量 + 自动双向调度，含整库 ZIP 备份）；AI 问答与智能规划（OpenAI 兼容 / Ollama / 自定义 provider，工具调用框架）；支持导入 .md / .txt / .pdf / .docx（自动嗅探编码）；笔记加

andrii-kryvoviaz/slink

Self-hosted image sharing service

ARahim3/mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

johnbean393/Sidekick

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp

psi-4ward/psitransfer

Simple open source self-hosted file sharing solution.

SharpAI/SwiftLM

⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

OpenSparX/MasterAgent

Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.

acon96/home-llm

A Home Assistant integration & Model to control your smart home using a Local LLM

xybrid-ai/xybrid

Cross-platform on-device AI toolkit

pikpikcu/airecon

AIRecon is an autonomous cybersecurity agent that combines a self-hosted Large Language Model (Ollama) with a Kali Linux Docker sandbox and a Textual TUI. It is designed to automate security assessmen

usemoss/moss

The retrieval layer for production AI systems. Lightning-fast (<10ms) search without vector databases. Built for browser, edge, on-device, and cloud.

smaramwbc/statewave

Open-source memory runtime for AI agents — reproducible, provenance-tagged context bundles instead of query-time retrieval. Apache-2.0, self-hosted on Postgres + pgvector, Python + TypeScript SDKs.

qdrant/qdrant-web-ui

Self-hosted web UI for Qdrant

swarmclawai/swarmclaw

Open-source self-hosted AI agent runtime and multi-agent framework for autonomous agent swarms. Agent memory, MCP tools, schedules, delegation, and 23+ LLM providers (Claude, GPT, Gemini, OpenRouter,

zolotukhin/zinc

Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

hybridgroup/yzma

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

datawhalechina/handy-ollama

动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollama/

RunanywhereAI/on-device-browser-agent

On-device AI browser automation using WebLLM. No cloud, no API keys, fully private.

Scottcjn/trashclaw

Local LLM agent for vintage Mac hardware. Built on a 2013 Mac Pro trashcan with dual AMD FirePro D500s. Elyan Labs.

balzack/databag

fast & lightweight self-hosted messenger

kantord/SeaGOAT

local-first semantic code search engine

hogeheer499-commits/strix-halo-guide

Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

eastriverlee/LLM.swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

guaardvark/guaardvark

The self-hosted AI workstation. Autonomous screen agents, 3-tier neural routing, parallel agent swarms, video generation, 4K/8K upscaling, RAG, voice interface, 60+ tool execution engine — all running

zhongkaifu/TensorSharp

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for

ridhwaans/homehost

self-hosted, Netflix-like app made for streaming

abdulmominsakib/localmind

A mobile application designed to provide a beautiful, fast, and privacy-respecting interface for on device LLM and local LLM servers and cloud providers

goruck/home-generative-agent

AI agent for Home Assistant — talk to your home, create automations in plain language, analyze cameras with face recognition, and get proactive anomaly alerts. Cloud LLMs or fully local via Ollama.

kytmanov/obsidian-llm-wiki-local

Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concepts → your Obsidian wiki auto-links and grows. Zero sharing. Your notes stay yours.

nhat141210/Elite-Danerous-Assistant

Vietnamese-first AI ship companion for Elite Dangerous, with live Journal awareness, local LLM support, voice, overlay, vision, and flight-session memory.

AlexsJones/llmserve

A simple TUI for serving local LLM models. Pick a model, pick a backend, serve it

timtoole02/Camelid

Camelid: a Rust-native local inference backend with evidence-gated model compatibility.

openma-ai/open-managed-agents

Open-source Claude Managed Agents API implementation and self-hosted Claude Tag-style agent runtime. Drop-in compatible; runs on Cloudflare Workers/Durable Objects or Node.js. Apache 2.0.

ozgrozer/ai-renamer

A Node.js CLI that uses Ollama and LM Studio models (Llava, Gemma, Llama etc.) to intelligently rename files by their contents

smixs/iva-agent

AI assistant in Telegram that remembers everything and helps you run your life. Self-hosted in one command.

wangeai/K3Flight

Run Kimi K3 locally on CPU with ~55GB measured runtime RAM. A single-file Linux inference server powered by cPilot Runtime.

aghyad97/browserytools

152 free browser-based tools in 17 languages. Your files and text are processed in your browser — no uploads, no accounts, no ads. Image & on-device AI tools, PDF, converters, formatters, calculators,

scouzi1966/maclocal-api

'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Sup

fluxions-ai/vui

Vui Nano — a small, context-aware text-to-speech model trained on real conversations. 219M active params (305M total), Apache 2.0, voice cloning, streaming, runs on CPU (dependency-free C build). Ship

OpenBMB/MiniCPM-Robot

A Smarter and Faster On-Device AI Brain for Robots

kevinhermawan/Ollamac

Mac app for Ollama

jjang-ai/jangq

JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon

sammcj/gollama

Go manage your Ollama models

crosswk/SayIt

Open-source voice typing for Windows — a Wispr Flow / Superwhisper alternative. Press a shortcut, speak, and AI-polished text lands at your cursor. Local models, your own API keys, or a self-hosted ba

livecontext-ai/livecontext-ce

The AI automation platform, self-hosted. Describe the job in chat and LiveContext builds it: readable workflows, scoped AI agents, and small apps your team uses. Chat, Workflow, Agent and App on one c

mit-han-lab/tinyengine

[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256K

instantsoft/icms2

Self-hosted Site Management System

Picovoice/rhino

On-device Speech-to-Intent engine powered by deep learning

Notely-Voice/NotelyVoice

A 100% private AI voice transcription app that converts speech to text in 100+ languages. Built with Compose Multiplatform for Android & iOS using Whisper AI - no cloud uploads, all processing happens

ritesh-kanwar/Cashiro

Cashiro is a comprehensive financial tracking manager that Turn bank SMS and PDF Statements into a clean, searchable money timeline with on-device AI assistance. 100% private, no cloud processing.

tucan9389/awesome-ml-demos-with-ios

The challenge projects for Inferencing machine learning models on iOS

michaelwilhelmsen/humla

Open-source AI meeting notes for Mac. Records mic + system audio with no bot, transcribes on-device or via OpenAI / Deepgram / Groq, identifies speakers offline, and writes summaries that fuse your no

Robitx/gp.nvim

Gp.nvim (GPT prompt) Neovim AI plugin: ChatGPT sessions & Instructable text/code operations & Speech to text [OpenAI, Ollama, Anthropic, ..]

defilantech/LLMKube

Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, mo

curiousily/AI-Bootcamp

Self-paced bootcamp on Generative AI. Tutorials on ML fundamentals, Ollama, LLMs, RAGs, LangChain, LangGraph, Fine-tuning, DSPy & AI Agents (CrewAI), (Using ChatGPT, gpt-oss, Claude, Qwen, Gemma, Llam

tmseidel/ai-git-bot

The self-hosted AI workflow automation platform for Git repositories.

3sk1nt4n/cybersentinel-ai

Agentic-AI CyberSecurity Arsenal || 33 real tools, runs 100% locally and 100% Free

5p00kyy/club-5060ti

Practical local LLM recipes and benchmarks for RTX 5060 Ti setups

inferock/inferock-bench

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.

tdi/awesome-private-ai

Curated list of tools, frameworks, and resources for running, building, and deploying AI privately — on-prem, air-gapped, or self-hosted.

dtsola/xiaoyaosearch

小遥搜索，听懂你的话、看懂你的图，用AI找到本地任何文件。让搜索像聊天一样简单。XiaoyaoSearch: Understands your words, reads your images, finds any local file with AI. Making search as easy as chatting.

lone-cloud/gerbil

A desktop app for running Large Language Models locally.

JPeetz/Hermes-Studio

Web UI & dashboard for Hermes Agent — chat, memory, skills, terminal, approvals, multi-agent orchestration. Self-hosted.

mit-han-lab/TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

Picovoice/leopard

On-device speech-to-text engine powered by deep learning

mlx-node/mlx-node

kytmanov/synto

More than just Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concepts → your Obsidian wiki auto-links and grows. Zero sharing. Your notes stay yours.

theaiautomators/insights-lm-public

Open-source, self-hosted alternative to NotebookLM. Chat with your documents, generate audio summaries, and ground AI in your own sources—built with Supabase and N8N on a React frontend.

Powertracall/local-llm-suite

Local Llm Suite

pasrom/meeting-transcriber

On-device meeting transcriber for macOS — auto-records Teams/Zoom/Webex, transcribes & separates speakers locally. No cloud. Open-source alternative to Otter/Granola/Fireflies.

karrioapi/karrio

Programmable Shipping APIs (self-hosted)

HybridAIOne/hybridclaw

Enterprise-ready self-hosted AI assistant runtime with sandboxed execution, secure credentials, approvals, and memory

jegly/OfflineLLM

Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Accel

iblameandrew/deepsearch-academic

An implementation of Google Deep Search with support for 1000+ references, local inference, chatting with your scraping session using RAPTOR, and report generation.

jabberjabberjabber/ImageIndexer

Creates an index of images, queries a local LLM and adds tags to the image metadata

nihalashetty/Forge

Forge is an open-source, self-hosted alternative for visually building and shipping AI agents and workflows without giving up control of your infrastructure.

Greninja9257/LabLLM

A native macOS lab for teaching tiny language models to think — build the architecture, train the weights, and watch a small LLM emerge from scratch, locally on Apple Silicon with custom data, tokeniz

Bino5150/lumina

A full featured, powerful, and efficient AI Agentic Harness/Desktop Agent app designed from the ground up with local inference on consumer hardware in mind. It evolves, grows, and gets smarter as you

neonwatty/meme-search

The open source Meme Search Engine and Finder. Free and built to self-host locally with Python, Ruby, and Docker.

hwdsl2/self-hosted-ai-stack

Deploy a self-hosted AI stack with Docker Compose: local LLMs, chat, document parsing, embeddings, transcription, text-to-speech and MCP tools. Powered by Ollama, LiteLLM, AnythingLLM and more. Local-

BodhiSearch/BodhiApp

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

kstonekuan/simple-chromium-ai

TypeScript library for Local LLM in Chromium browsers

newideas99/open-dungeon

Open Dungeon — the first easy-to-use, fully local AI roleplay app. Story and inline scene images generated 100% on your machine (Gemma 4 QAT via Ollama(and others) + FLUX). No accounts, no API keys, n

arcahyadi/odysseus

Self-hosted AI workspace.

Ganador1/FenixAI_tradingBot

Fenix Ai Trading Bot with LangGraph and ollama and multipe providers

Mesutcydev/ForgeSign-iOS

ForgeSign for iOS — on-device IPA re-signer. Sign, install and manage IPAs entirely on the device: zsign engine, liquid-glass UI, remembered certificates with expiry countdown, signed-app library, loo

off-grid-ai/OGAD

Off Grid AI — private, on-device AI. Run open models (text, vision, image, voice) locally through one OpenAI-compatible gateway. No cloud, no accounts, no API keys.

Ninnix/q36

Qwen3.8-27b and Qwen3.6-35B-A3B local inference engine for Vulkan and Metal

Hal0ai/hal0

Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.

hwdsl2/docker-whisper

Docker image for a self-hosted Whisper speech-to-text server with speaker diarization and OpenAI-compatible transcription and translation APIs. Powered by faster-whisper. Supports all Whisper models,

dreamfactorysoftware/df-core

DreamFactory is a self-hosted platform providing governed API access to any data source for enterprise apps and local LLMs.

infervisor/plow

Packet Language for On-device Warps — a GPU inference compiler and runtime

voidmind-io/voidllm

Privacy-first LLM proxy and AI gateway - load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

soniqo/speech-core

On-device VAD / streaming STT / TTS / diarization in C++17 (ONNX + LiteRT) with a voice-agent pipeline. Linux, Windows, Android.

zhouwg/kantv

workbench for learning and practicing on-device AI technologies under real-world scenarios on Android smartphones with online TV. powered by llama.cpp + whisper.cpp + FFmpeg + opencv-mobile

Epistates/pmetal

PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.

fypklanfanqie/local-llm-with-character-setting-Arknights

一款运行在安卓设备上的 LLM 对话助手应用。你可以自行下载并管理模型，自由定制角色人设，并随时在本地推理（部分机型支持 GPU/NPU 加速）与云端模型之间切换。同时内置 TTS 语音合成功能，让对话更加鲜活。 An Android LLM chat assistant that lets you download and manage your own models. Customize ch

ndom91/briefkasten

📮 Self hosted bookmarking app

manjunathshiva/turboquant-mlx

Extreme weight + KV cache compression for LLMs on Apple Silicon (MLX implementation of Google's TurboQuant)

Picovoice/cobra

On-device voice activity detection (VAD) powered by deep learning

grregis/MuckScraper

Self-hosted news aggregator with LLM bias scoring and summarization.

nanoAgentTeam/research-claw

A self-hosted AI assistant for academic research — manages your papers, searches literature, tracks deadlines, and answers you on the channels you already use.

mrdjohnson/llm-x

LLMX; Easiest 3rd party Local LLM UI for the web!

adammikulis/local-agents

Local Agents is an add-on for Godot 4.5 to run LLMs locally in games

orgexyz/BlockAGI

Your Self-Hosted, Hackable Research Agent Inspired by AutoGPT

akx/ollama-dl

Download models from the Ollama library, without Ollama

saurabhav88/EnviousWispr

Free, sub-second on-device AI dictation for macOS. Dual engines (Whisper + Parakeet) on Apple Silicon. Optional AI polish with our own on-device model (EG-1), Apple Intelligence (macOS 26), Ollama, or

soniqo/speech-android

On-device speech SDK for Android — ASR, TTS, VAD, and noise cancellation powered by ONNX Runtime with Qualcomm NNAPI acceleration

benmaster82/writher

🎙️ Offline voice productivity for Windows - dictate text into any app and control a local AI assistant by voice. Manages notes, to-do lists, appointments & reminders. 100% local: faster-whisper + Olla

withcatai/catai

Run AI ✨ assistant locally! with simple API for Node.js 🚀

ErezShahaf/Lore

Summon it with a keystroke, throw in anything you want to remember or ask your own memory. A local LLM agent that restructures your knowledge into a vectorized DB. fully private, zero cloud.

rixinhahaha/snip

The visual communication layer between humans and AI agents. Capture, annotate, render diagrams, and organize with AI — powered by Electron and Ollama. macOS & Linux.

alexvilelabah/bah-browser

Open-source AI browser agent — type plain-language commands and Bah operates the web for you. Works with cloud AI (DeepSeek, Mistral, NVIDIA) or local Ollama models.

orangekame3/mirrormate

Self-hosted personalized AI in a mirror.

BrettKinny/dotty-stackchan

Self-hosted voice-assistant stack for the M5Stack StackChan desktop robot. Local ASR/TTS, pluggable LLM brain, kid-mode default, no cloud required.

Picovoice/pico-cookbook

On-device AI recipes for building private, real-time applications with production-grade voice, language, and vision SDKs. Ready-to-use, open-source code examples.

saidkaban/expo-ai-kit

On-device AI for Expo and React Native. Local LLM, speech-to-text, vision, and embeddings. No API keys, no cloud.

ariso-ai/oats

The free, open-source meeting-notes app for your Mac — offline transcription and AI notes, free in the cloud or 100% on-device.

yoloyash/overtchat

A simpler self-hosted alternative to Open WebUI. Bring your own API keys or local models. Native Android client.

gengchaogit/llm_speedtest

Local LLM Inference Speed Test Tool

YuriCrystal/n8n-marketing-flows

開源 n8n 行銷自動化模板庫 — 79 支可一鍵匯入的工作流(社群/輿情/新聞/廣告/SEO),含免費本機 Ollama 版 + 待接 key 架構範本。Free & open-source n8n marketing-automation workflow templates.

Tomotsugu-dev/Hindsight

Local-first desktop activity tracker — see where your hours go, with on-device AI daily summaries and optional multi-device sync

deepanwadhwa/samosa-chat

Run large models like Qwen3.6-35B-A3B locally on a 16 GB RAM machine

escapeboy/agent-fleet-o

Open-source AI agent orchestration platform — self-hosted mission control for autonomous multi-agent systems. Visual DAG workflows, 450+ MCP tools, human-in-the-loop approvals. Works with Claude, GPT-

glimpse-hq/Glimpse

Voice dictation that stays on your device. Open-source, local-first, and built for people who actually care about privacy.

bartvantuijn/noton

A free and open documentation platform built with Laravel and Filament, enhanced by Ollama and OpenClaw for private AI features, focused on clarity, structure, and self-hosted simplicity.

PTEz/LumberjackConsole

On-device CocoaLumberjack console with support for search, adjust levels, copying and more.

BrutalCoding/aub.ai

AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

uncSoft/anubis-oss

Local LLM Testing & Benchmarking for Apple Silicon

Visterainer/aidea-zotero

AIdea — Free AI chat in Zotero's side panel. OAuth login (no API key needed), supports OpenAI-compatible APIs and local models (Ollama, LM Studio). | 免费 AI 助手，Zotero 侧边栏对话，OAuth 登录无需 API Key，支持 OpenAI

kossisoroyce/timber

Ollama for classical ML models. AOT compiler that turns XGBoost, LightGBM, scikit-learn, CatBoost & ONNX models into native C99 inference code. One command to load, one command to serve. 336x faster t

Chleba/ollamaMQ

High-performance LLM backends proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.

Mybono/ai-orchestrator

Portable multi-agent AI developer setup for Claude Code + Ollama. Role-based local LLM orchestration via Bash — plan, code, review, commit. Zero Dependency. Works with any language stack.

RisorseArtificiali/anti-vocale

Android app for transcribing voice messages locally on-device, with no internet required.

canonical/inference-snaps

Local inference, optimized for your hardware

six-ddc/livecaption

Real-time on-device speech transcription + translation for macOS (Apple Silicon). Streaming ASR, speaker diarization, and live English→Chinese translation on Apple GPU/MLX — terminal CLI, no UI, no cl

peva3/SmarterRouter

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.

shreyaskarnik/DistiLlama

Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations private. 🔐

Mininglamp-AI/cider

W8A8/W4A8 inference + optimized SDPA on Apple Silicon — unlocking unused INT8 TensorOps in M5 for 1.2–1.9× faster LLM prefill, plus FlashInfer-inspired GQA decode attention for up to 1.6× SDPA speedup

sliamh11/Deus

A token-efficient open-source AI assistant that remembers, adapts, and improves — secured, self-hosted, and entirely yours.

rbc33/Ghostbar

Free macOS-native Cluely alternative. AI chat invisible to screen sharing. Ollama, OpenAI, Claude. Swift. No Electron. No subscription.

langhost/langhost

Open-source, self-hosted LangGraph Agent Server. Production Postgres + Redis. Same SDK. Same Studio. Zero code changes.

charan820/PhantomCrowd-Simulacra

PhantomCrowd AI Marketing Simulator 2026: Content Spread Forecasting with Local LLM

calcuis/gguf-connector

gguf (GPT-Generated Unified Format) connector

Mayurkoli8/ChatDouble

A private AI chatbot platform where users can upload real chat history and recreate bots that mimic their friends' personalities. Built using Streamlit + FAISS + Mistral via Ollama.

cristianadam/llama.qtcreator

Local LLM-assisted text completion for Qt Creator.

janhq/server

Self-hosted agentic AI platform powered by local models

assafkip/kipi

Open-source, self-hosted OSINT investigation platform: turn documents into a live, investigated entity graph. Autonomous agent, graph analytics (centrality, communities, pathfinding), keyless-first to

Aatricks/llmedge

Android native AI inference library, bringing text, image, video, STT, TTS inference

logxio/picchio

Catches silent CPU fallback and mislabeled tok/s in local LLMs. llama.cpp and ollama, one file, no deps.

PeterGreenAppliedAI/Invarail

Local-model-first AI agent framework — Router + Specialist architecture for Ollama

hwdsl2/docker-whisper-live

Docker image for a self-hosted WhisperLive real-time speech-to-text server, powered by faster-whisper. Provides WebSocket streaming for live audio transcription and an OpenAI-compatible REST API. Supp

vishakhasadhwani/llm-deployment-demo

Self-hosted LLM chat app using vLLM + Streamlit + Docker — deploy locally or on AWS EC2

hikarioyama/ParallelHue

Truthful scheduler-step and streaming visualization for local LLM inference

shaircast/vvrite

On-device AI transcription macOS app that transcribes your voice and pastes the text

fiveoutofnine/whatcanirun

Find the best models and how to run them locally.

townsendmerino/goinfer

Pure-Go, no-cgo local LLM inference — run Gemma, Qwen, Llama and friends from safetensors or GGUF in a single static binary.

Picovoice/falcon

On-device speaker diarization powered by deep learning

Eldoprano/offline-browser-translate

Privacy-focused translation using local LLMs (Ollama, LMStudio).

hanxiao/dataroom

Give a query, get a dataroom. Pi + self-hosted Qwen3.6 research harness on a single L4.

Helldez/HearoPilot-App

On-device AI meeting assistant — real-time transcription & LLM insights, 100% offline

antonellof/ferrox

Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.

AetherAI3/Unlimited-Context-LLM

Give any local LLM a billion-token memory. Open-source, local-first context + memory engine for Ollama and AI agents — runs on your own machine, free. 🧠⚡

Bitshank-2338/clicky-windows

Free offline AI assistant for Windows — reads your screen, hears your question, speaks the answer. No API key, runs locally with Ollama.

nanograph/nanograph

On-device property graph database. Schema-as-code. One CLI → One Folder. No Server. Think: DuckDB for graphs.

antgroup/Napaxi

Mobile-native agent SDK for building on-device AI agents with sandboxed execution, extensible tools, and x-app / x-agent / x-channel connectivity.

ClawixAI/clawix

Open-source, self-hosted multi-agent AI orchestration platform. Run agents in isolated Docker containers with swarm coordination, RBAC, token governance, and multi-channel support.

Techopolis/afm-Server

macOS menu bar app that exposes Apple's on-device Foundation Models as an OpenAI-compatible local API. Zero cloud. Zero dependencies.

lukasbach/pensieve

Desktop app for recording meetings from locally running apps and transcribing and summarizing them with a local LLM

artcc/openclient-llm

Open-source native iOS, iPadOS & macOS LLM client for LiteLLM, Ollama and OpenAI-compatible APIs. Built with SwiftUI.

yuga-hashimoto/and-code

Native Android GUI for running AI coding agents locally on-device. No terminal or PC required.

RudySen/comfyui-muse

Local LLM chat panel for ComfyUI — LM Studio & Ollama, multi-session, vision support, Guide Materials

rudi-q/glucose_media_player

A Full-Featured, Powerful & Ultra-lightweight, video player for Windows with on-device AI powered subtitle generation. Tauri + Svelte

umutkeltek/healthsave-observatory

Self-hosted health-data observatory: sync Apple Health, early wearable plugins, and Garmin/Samsung imports into a canonical TimescaleDB record; view baseline-linked findings and query a private API. D

littleseven/polang

PoLang is an on-device AI agent smart photo gallery that treats the LLM as the central nervous system of the app. It serves as a living experiment for next-generation AI-first client architectures.

FareedKhan-dev/glm-5.2-in-c

GLM-5.2, a 744 billion parameter mixture of experts model, in a pure C inference engine: quantized to int4, experts streamed from disk, deployed and benchmarked. Generates in 16 GB of RAM.

Picovoice/koala

On-device noise suppression powered by deep learning

ovoment/ovo-local-llm

A private Claude-Code-style coding agent for Apple Silicon — run chat, code, and local model workflows on-device. MLX-native, Ollama/OpenAI API compatible, zero API keys.

jeho-lee/Awesome-On-Device-AI-Systems

Badtheorylabs/Macaw

Macaw — on-device AI agent for macOS. 2.7B LFM2.5 fine-tune, MLX 4-bit, 97 macOS tools, no cloud.

xencon/aixcl

Agentic SDLC with local LLM's.

snapllm/snapllm

🔥 Alternative to Ollama — multi-model serving with sub-ms model switching · CPU-only 20B inference for Edge AI · llama.cpp + stablediffusion.cpp

efeslab/ConsumerBench

A benchmarking framework for on-device AI

arozanov/turboquant-mlx

TurboQuant KV cache compression for MLX with fused Metal kernels. 4.6x compression at 98% FP16 speed.

CrispStrobe/CrisperWeaver

On-device speech-to-text Flutter app powered by CrispASR (ggml / Whisper) — offline, multi-platform, AGPL-3.0.

loomax-labs/InferrLM

InferrLM - On-device AI for iOS & Android

supertone-inc/supertonic-py

Lightning-Fast, On-Device TTS — running natively via ONNX.

lpalbou/mlx-gen

Generative image and video runtimes for Apple Silicon (MLX): text/image-to-image, instruction editing, masked edit, text/image/reference-to-video, video editing, and restoration.

sina2266/Gozar

Self-hosted, Docker-first OpenAI-compatible LLM gateway with provider routing, fallbacks, API keys, and usage controls.

goldenplums2003/model_brain_surgery

Perform vector ablation to local LLM models

PangMo5/SwiftyCrow

Fully on-device on-screen translator for macOS: region capture and live overlay, powered by Vision OCR and Apple Translation

helgklaizar/turboquant-mlx

TurboQuant MLX: Flagship high-performance model quantization for Apple Silicon. Squeeze maximum inference speed and memory efficiency out of your MLX models with zero compromises.

sagawrr/react-native-nitro-vision-kit

On-device subject cutouts, image labels, and OCR for React Native. Apple Vision (iOS) · Google ML Kit (Android). Built with Nitro Modules.

zetic-ai/ZETIC_Melange_apps

NPU powered On-device AI Mobile applications using Melange

mukel/gemma4.java

Fast Gemma 4 inference in pure Java

mikjee/warpdrv

Local LLM Server Manager + LlaMA.cpp + Chat

oxide-lab/Oxide-Lab

Modern desktop application (Rust + Tauri v2 + Svelte 5 + Candle (HF)) for communicating with AI models that runs completely locally on your computer. No subscriptions, no data sent to the internet — j

ethicals7s/awesome-local-ai

152 open-source tools to run LLMs 100% locally – no cloud, no API keys, no censorship

Hyper-AI-Lab/cyber-ai-team

Self-hosted AI company OS for solo founders: autonomous agents, ERPNext business memory, and owner-visible governance.

ITSpecialist111/HASS-AI-Orchestrator

An autonomous multi-agent orchestration system for Home Assistant. Features local LLM control (Ollama/DeepSeek), & RAG-powered technical knowledge,

barakugav/executorch-rs

Rust bindings for ExecuTorch - On-device AI across mobile, embedded and edge for PyTorch

nicedreamzapp/browser-agent

Local browser agent: MLX + Chrome DevTools Protocol. Handles cross-origin iframes, Shadow DOM, ProseMirror. Runs on Apple Silicon, no cloud.

Cyclenerd/android-llm-server

🔥 Local LLM Server for Android (Google Gemma 4, LiteRT, OpenAI API)

joreilly/OnDeviceAI

Extremely minimal Compose Multiplatform sample that demonstrates use of on-device AI on iOS and Android.

jorgeadev/cutout-studio

Privacy-first, on-device AI background remover for batch images with model selection, edge refinement, custom backgrounds, and flexible exports.

premthomas/Ollama-and-Agents

Implementing Ollama and Agents to create a blogging bot

YashBhadange2006/TinyAI

On-device AI assistant for Android built with Kotlin, featuring local LLM inference, offline AI capabilities, and edge AI experimentation.

techulus/manage-prompt

Local LLM call debugger

MikeSchirtzinger/silent-notetaker

Private, on-device AI meeting notetaker that runs entirely in your browser — live transcription, speaker ID, and note extraction with no audio leaving your machine (WebGPU + WASM).

elbruno/ElBruno.LocalLLMs

C# local LLM chat completions library using ONNX Runtime, compatible with Microsoft.Extensions.AI

aaronnat23/disp8ch

Self-hosted AI workspace where chat becomes visual workflows, multi-agent operations, and reviewable automations. Local memory; local or cloud models

OrihuelaConde/LiteRtLmSharp

Unofficial .NET bindings for Google's LiteRT-LM — on-device LLM inference (Gemma) for Windows, Linux, Android, macOS & MAUI

stevyhacker/lokalbot

A local LLM workhorse that keeps a memory of your workday. On-device meeting notes, dictation, autocomplete, and recall for macOS. GPLv3.

junmo-kim/mac-local-vision

Zero-token, on-device vision for AI agents — OCR, pixel-exact UI targeting, and face grouping on Apple Vision. Pure Swift, single binary, no dependencies.

thewafflehaus/butter

Melt away latency with ultra-smooth local inference

yanghao1143/rust-norion

Rust Noiron/Norion self-evolving local LLM runtime engine for non-commercial research deployment

Ritiksuman07/quant-whisper

A hedge fund on your local machine. Terminal-native algo trading engine in Go with local LLM inference (Ollama), Bubble Tea TUI, paper/live trading, and zero cloud dependency. BYOB.

flamehaven01/Flamehaven-Filesearch

Self-hosted RAG search engine — 34 formats, BM25+hybrid search, multi-LLM (Gemini/OpenAI/Claude/Ollama), FastAPI + Docker, production-ready in 3 min

TRI-Tech-Revolution-Intelligence/LocalLLM

Easily run LLMs locally using llama.cpp directly, without overhead.

GijungKim/expo-local-llm

Expo module for on-device LLM inference via Apple Foundation Models (iOS) and Gemini Nano (Android)

humanrouter/ddtree-mlx

Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port with custom Metal kernels for hybrid model support.

asher/gmlx

Local inference platform for K/IQ-quant GGUF models on Apple Silicon

Natxo09/Eris.

Eris is a private AI chat application that runs entirely on your device using Apple's MLX framework. Named after the dwarf planet that challenged our understanding of the solar system, Eris challenges

yumiaura/aicommit

AI commit messages from your local LLM - Ollama / llama-cpp backed, offline, Conventional Commits, with review + changelog modes.

Arthur-Ficial/apfel-chat

Super-fast, lightweight, 100% local chat client for on-device AI via apfel

IEEE-VIT/priv-guard

Mobile app designed to help users analyze their digital privacy by scanning text-posts, photos and videos to safely detect oversharing risks using on-device AI and encrypted local storage.

wundercorp/openmodel

Use any AI model, locally or in the cloud, while tracking on-device token usage and collecting token telemetry data.

intrepidkarthi/dailyvox

Free open-source voice journal for iPhone with on-device AI. Every entry becomes a star in your private constellation. Built with SwiftUI, Apple Speech, NaturalLanguage, ActivityKit. MIT licensed.

di37/running-llms-locally

A comprehensive guide for running Large Language Models on your local hardware using popular frameworks like llama.cpp, Ollama, HuggingFace Transformers, vLLM, and LM Studio. Includes optimization tec

geeks-accelerator/ollama-herd

Local AI load balancer for Ollama and MLX fleets. Auto-discovery, smart routing, OpenAI-compatible API, zero config. Perfect for Mac Minis & Studios.

marzukia/qMLX

qMLX: Custom inference engine for Qwen 3.5 122B on Apple Silicon, extending MLX with hybrid attention support, SSD-backed KV cache, and RYS layer duplication for efficient large-model serving on consu

thedavidweng/OpenKara

A desktop karaoke app that transforms your local music library into sing-along tracks using on-device AI stem separation and online synced lyrics, making karaoke affordable and reusable with the songs

wuwangzhang1216/ora

Real-time on-device speech translation for macOS. Silero VAD + Qwen3-ASR-1.7B + Qwen3.5 (MLX) on Apple Silicon. No cloud, no API keys, no telemetry.

joeynyc/spark-doctor

Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker issues, and validates vLLM/Ollama/llama.cpp/SGLang recipes.

dmitryryabkov/local-ai-mac

Practical guide to running LLMs locally on Apple Silicon, with a focus on architecture, memory scaling, and agent workflows.

sbhavani/jules-app

self-hosted workspace for Google's Jules AI agent

gerfalcon/offline_menu_translator

Flutter app demonstrating on-device AI with Gemma 3N

leonickson1/localLLM

Privacy-first iOS app with on-device LLM inference via llama.cpp. Chat with local models, get AI health insights from HealthKit, and track finances from PDF statements.

wassgha/weightlift

Load and manage on-device AI models with a simple javascript API.

hanxiao/mlx-vis

Pure MLX implementations of UMAP, t-SNE, PaCMAP, TriMap, DREAMS, CNE, MMAE, and NNDescent for Apple Silicon. Metal GPU for computation and video rendering.

DevOnBike/Overfit

Run, fine-tune and serve real LLMs entirely in-process in .NET — on the CPU, on-device, offline. No Python, no GPU, no cloud.

Ishabdullah/Aigentik-CLI

On-device AI assistant for Termux/Android that watches Gmail over IMAP, drafts and sends replies with a local llama.cpp model, and is controlled entirely by text or email — no cloud AI, no API keys, n

akash6344/wellfound-jobs-auto-applier

Automate Wellfound job discovery and applications using Playwright and a local LLM.

LifeValue/HealthWallet.me

Open-source, patient-controlled health record app with on-device AI. Aggregates medical data from 52K+ providers via FHIR R4. Offline-first. Flutter.

peteole/lm-writing-tool

VSCode extension that grammar-checks texts through a local LLM

Dakera-AI/dakera-deploy

Self-hosted Dakera AI memory server — Docker Compose, Kubernetes, Helm, HA cluster setup, and monitoring.

wesleysimplicio/simplicio-local

Ultra-fast 100% on-device Universal State Runtime for LLMs on Apple Silicon (M1–M5). DeepSeekV4/others on Mac M3 48gb RAM. Powered by MLX + Metal + ANE — extreme local inference, zero cloud, built for

ricardojustus/blaise

Local-first macOS meeting transcription & notes — on-device, PT/EN code-switching as a first-class case, structured notes with action items.

avbiswas/neural-txt

Super fast local inferencing for common NLP tasks on technical text

asa-degroff/Porrima

A self-hosted, memory-native AI agent framework and cross-platform GUI application.

NiharShrotri/llm-wiki

Local LLM-maintained personal wiki, built on Karpathy's LLM-Wiki pattern. Runs on Ollama + Qwen3 + QMD.

wuxuedaifu/supertonic_cn

Supertonic-ZH — fast on-device Mandarin TTS (pure ONNX). Now with streaming synthesis for real-time dialogue (low first-audio latency, barge-in).

nobodywho-ooo/flutter-starter-example

Flutter starter example app to get started with NobodyWho, a library designed to run LLMs locally and efficiently on any device.

tingyulu/MyParrot

Bot-free meeting recorder + transcriber for macOS. Stereo-split recording (them=L, you=R) = free speaker attribution, fully on-device.

docusealco/rllama

Ruby FFI bindings for llama.cpp to run open-source LLMs such as GPT-OSS, Qwen 3.5, Gemma 4, and Llama 3 locally with Ruby.

syfr512/SweetrollLM

Local-first AI chat client combining SillyTavern-style character cards, LM Studio-style GGUF model management, Ollama/OpenAI-compatible APIs, and an agentic workspace.

wil-pe/CATAI

🐱 Pixel art cats on your macOS dock — debate ideas with local AI

retkowsky/foundry-local

Foundry Local is an on-device AI inference solution that you use to run AI models locally through a CLI, SDK, or REST API

woosal1337/folio

Local-first meeting notes for macOS. Records system audio + mic, transcribes on-device with Whisper, and writes markdown to your vault — your audio never leaves your Mac.

guelfoweb/orbit

Local agentic AI runtime optimized for CPU-only consumer hardware, tool use and efficient local inference.

HPInc/ZGX-Toolkit

The Z Toolkit is a VS Code extension that enables developers to quickly configure their HP Z devices for model fine-tuning and local inference. It also provides automated discovery of devices in the l

gergelyvagujhelyi/CalculatorM3

A clean, private calculator with an optional on-device AI math solver — no tracking, no ads.

Open-Fable/OpenAxis

macOS AI workspace — chat, multi-agent orchestrator, code agent, design tool in one sidebar. Supports Anthropic, OpenAI, OpenRouter, Ollama, Gemini, and any OpenAI-compatible provider. MIT.

Whisper-AI-App/app

Whisper AI: Private on-device AI.

ekhos-ai/ollama-portable

a portable web chat interface for runnning local LLMs

rryam/MusaveraKit

App-friendly Swift APIs for Apple's on-device Music Understanding framework.

rokib16x/listnr

Local meeting listener for macOS. Captures your mic and system audio as two separate lanes, transcribes both on-device with WhisperKit, and labels You plus remote Speaker 1..N. Nothing leaves your mac

deepelementlab/jupyter-studio

The AI-native JupyterLab — open-source Cursor for notebooks. Cmd+K inline edit, multi-step agent with cell-level tools (read/edit/run), chat with @cell/@file context, ghost-text completion, one-click

tanavc1/local-llm-autotune

Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, and RAM usage by 3x.

lynxai-team/goinfer

Local LLM proxy, DevOps friendly

gaplopez1991/browsery-tools

136+ free browser-based tools for productivity & developers. 100% client-side — no servers, no uploads, full privacy. Image & on-device AI tools, file/format converters, code formatters, calculators,

arghyasur1991/LiveTalk-Unity

LiveTalk is a unified, high-performance talking head generation system that combines the power of LivePortrait and MuseTalk open-source repositories. The PyTorch models from these projects have been p

VoxRT/voxrt-asr-android

Streaming on-device speech recognition for Android — NEON-accelerated FastConformer (32M params), cache-aware streaming with 80 ms look-ahead, no cloud. Powered by the VoxRT runtime.

aqibsaeed/On-device-activity-recognition

Personalized machine learning on the smartphone

openronin/openronin

AI dev teammate for GitHub. Picks up issues, asks questions, ships PRs, answers your review comments, resolves conflicts, merges when green. Self-hosted.

zetic-ai/awesome-on-device-ai-apps

Open-source production-ready mobile server-less AI apps. Clone, customize, and ship on Android & iOS with MLange.

monk1337/auto-ollama

run ollama & gguf easily with a single command

darnodo/audio-summary-with-local-LLM

This tool is designed to provide a quick and concise summary of audio and video files. It supports summarizing content either from a local file or directly from YouTube. The tool uses Whisper for tran

konjoai/squish

⚡️ The fastest way to run local LLMs on Apple Silicon — sub-second model loads, beats Ollama on throughput, tail latency, and full-response time. OpenAI/Ollama-compatible. No cloud, no API keys.

k1LoW/vo

On-device live transcription and translation CLI for macOS 26+ on Apple Silicon

dialogflowai/dialogflow

An easy dialog flow with a intuitive flow editor, include a local LLM manager and integrated Ollama and OpenAI.

MD-Mushfiqur123/lychee

Universal local LLM runtime. Drop-in Ollama replacement with HuggingFace integration, pipelines, structured output. Free & open source.

ulyssestenn/omt

Ollama Model Test - Figure out the best model for the task

0xbrando/dictate

Push-to-talk voice dictation for macOS. 100% local, free, open source. Apple Silicon MLX. No cloud, no subscription.

Jerome-Graves/meowtion

A smart cat collar that monitors your cat's health through its habits. On-device AI tracks eating, drinking, activity, rest and purring, surfacing the routine changes that can flag illness early (cats

timokoethe/Localight

A SwiftUI showcase app for Apple’s Foundation Models on iOS 26 and iOS 27. Discover private, fast, and fully on-device AI experiences built with SwiftUI.

MacPaw/Fast-dLLM-mlx

Fast-dLLM inference engine on mlx

navikt/mlx-workspace

Run LLMs locally on Apple Silicon with MLX and wire up AI coding tools to your local server — no cloud calls.

dinoy-raj/gemini-nano-playground

Experimental Android app designed to showcase Android's Built In on-device AI. Utilises the Gen-AI Prompt API to interface locally with Google's Gemini Nano model, featuring a modern architecture buil

arghyasur1991/Spark-TTS-Unity

Unity package for using Spark-TTS on-device models. This is a C# port of https://github.com/SparkAudio/Spark-TTS by SparkAudio team and uses converted ONNX models instead of the PyTorch models in the

VoxRT/voxrt-asr-ios

Streaming on-device speech recognition for iOS — NEON-accelerated, encrypted FastConformer (32M params), RTF 0.08–0.10 on iPhone 13 Pro Max. Built on the VoxRT custom Rust inference runtime. SwiftPM d

KathanModh259/latent-gate

VL-JEPA inspired pipeline — compress images/text locally via Ollama, send compact payloads to any LLM API. Cut token costs by ~80%.

MuratBuker/Local-LLM-Stack-Documentation

Local LLM stack with open-source components and documented the installation and configuration steps.

ahoylabs/gguf.js

A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files

hoangnhat42/guru-mono

Self-hosted AI workspace for building containerized React and Go applications from natural-language specifications.

raspoli/mlx-serve

Local inference server for Apple Silicon — hot-swaps MLX models (LLM, vision, embeddings, TTS, STT) via OpenAI API

benedict2310/ora

Privacy-first macOS voice assistant powered by on-device AI

john-rocky/VLMKit

On-device structured VLM fan-out on Apple Silicon (MLX): pair Apple Vision with a local VLM to count, locate, and describe. Multi-demo example app.

Alphonso84/RayBan_Meta_NoteBuddy

iOS app that turns Ray-Ban Meta smart glasses into a hands-free study tool. Scan documents, extract text with OCR, generate AI summaries with Apple Foundation Models (Apple's On-Device AI) or online L

jesture-ai/jesture-sdk

Official repo for Jesture AI SDK: Real-time On-device Hand Gesture Control

pablocaeg/sloptotal

Open-source AI text detector — VirusTotal for AI slop. 23 engines, self-hosted, runs on CPU. Scan text or URLs locally.

VoxRT/voxrt-asr-models

Pre-compiled ASR model weights for the VoxRT on-device runtime. Encrypted .vxrt v2 format. streaming-medium-pc: FastConformer 32M, CTC + RNN-T, CC-BY-4.0 (NVIDIA NeMo).

hyparam/hyllama

llama.cpp gguf file parser for javascript

Jewelzufo/granitepi-4-nano

Run IBM Granite 4.0 locally on Raspberry Pi 5 with Ollama.This is a privacy-first AI. Your data never leaves your device because it runs 100% locally. There are no cloud uploads and no third-party tra

bluejacketblackhawk/saysomething

Free, local voice dictation for Windows and Mac. Hold a key, speak, your words appear at the cursor. On-device Whisper, no cloud, no account, no telemetry.

nobodywho-ooo/react-native-starter-example

React Native starter example app to get started with NobodyWho, a library designed to run LLMs locally and efficiently on any device.

MutantSparrow/JustRayzist

A lightweight CUDA-based local inference platform built around Z-Image Turbo by Tongyi

jhammant/retrace

A private, on-device macOS rewind: capture, search, and scrub back through your day. 100% local, no telemetry.

JustLateNightAI/Agent2077

Self-hosted private AI agent workspace for local and OpenAI-compatible models. Chat, code, use tools, manage memory/skills, route tools intelligently, and deploy Docker-backed apps from one browser UI

Arthur-Ficial/translate

On-device translator for macOS Tahoe — UNIX filter + drop-in HTTP server compatible with DeepL, LibreTranslate, and Google v2. 100% on-device, no cloud, no LLM, no API keys.

Baldwinzc/citelocal-agent

100% local research agent for your papers - ask PDFs on your machine, page-accurate verified citations, cross-paper synthesis, Ollama-ready

sanath-kumar-s/CleverWick

Electron + Next.js desktop AI assistant that runs GGUF models locally using llama.cpp. Designed for offline use, portability, and zero-install deployment.

sandseb123/local-lora-cookbook

Fine-tune a local LLM on your own app's data in 15 minutes. Runs entirely on-device, zero cloud after training. Apple Silicon + CUDA.

SolaryKryptic/llama-launcher

A bare-bones GUI application for the local inference engine, llama.cpp. Built-in TPE optimiser to find the best flags for your system

Emart29/phi4-finance-finetuning

Fine-tuning Microsoft Phi-4 Mini 3.8B on SEC 10-K financial Q&A using QLoRA — +69% ROUGE-L over base model. Live demo on Hugging Face.

JayacharanR/Clean-Backup

Intelligent media organizer with Rust-powered perceptual deduplication, on-device AI classification (scene + face recognition via ONNX), EXIF-based date organization, Google Drive sync, and a React da

Helldez/Resonance

P2P AI Semantic Connection — decentralized infrastructure for a network of on-device AI agents that meet the needs of people, entities, and companies through semantic matching, with no server and no c

Otosaku/OtosakuKWS-iOS

Lightweight on-device keyword spotting engine for iOS using CoreML and real-time audio streaming.

AndreiBulzan/heed-wakeword

Tiny, Apache-2.0 wake-word detection you train yourself and run on-device in Python, the browser, and on mobile.

thilomichael/llama-buddy

CLI wrapper for llama.cpp providing an ollama-like experience

ARahim3/DigUp

Search your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, Windows and Linux, built on Google DeepMind's EmbeddingGemma 2.

sugarforever/chat-ollama

ChatOllama is an open source agentic app for running AI agents across local and hosted models.

microsoft/tgrep

Trigram-indexed grep with a client/server architecture for fast regex search in large codebases locally

zacharee/InstallWithOptions

Simple-ish app using Shizuku to install APKs on-device with advanced options

bahdotsh/wrkflw

Validate and Run GitHub Actions locally.

itsOwen/CyberScraper-2077

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

matthartman/ghost-pepper

100% private on-device voice models for speech-to-text and meeting transcription on macOS

allenpeng0705/EnvoyMesh

Decentralized P2P mesh for autonomous AI agents — self-sovereign identity, peer-to-peer chat, and on-device AI that negotiates tasks on your behalf. No central server.

pluja/whishper

Transcribe any audio to text, translate and edit subtitles 100% locally with a web UI. Powered by whisper models!

TheBlewish/Automated-AI-Web-Researcher-Ollama

A python program that turns an LLM, running on Ollama, into an automated researcher, which will with a single query determine focus areas to investigate, do websearches and scrape content from various

Mininglamp-AI/Mano-P

Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook — no data leaves your device.Mano-P 是一个开源 GUI-VLA 项目，支持在 Mac mini/MacB

meeb/tubesync

Syncs YouTube channels and playlists to a locally hosted media server

StikDebug/StikDebug

An on-device debugger/JIT enabler for iOS versions 17.4+, powered by idevice.

ml-explore/mlx-swift-examples

Examples using MLX Swift

youssofal/MTPLX

The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple

mflux-community/mflux

Apple MLX native implementations of state-of-the-art generative image & video models

supabase/cli

Supabase CLI. Manage postgres migrations, run Supabase locally, deploy edge functions. Postgres backups. Generating types from your database schema.

ml-explore/mlx-swift

Swift API for MLX

tuya-cloudcutter/tuya-cloudcutter

A tool that disconnects Tuya IoT devices from the cloud, allowing them to run completely locally.

liltom-eth/llama2-webui

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.

john-rocky/CoreML-Models

Core ML model zoo for iOS/macOS — PyTorch models converted to ready-to-use .mlpackage, each with a conversion script and SwiftUI sample app. Sibling repos cover Apple's Core AI framework (iOS/macOS 27

trevin-creator/autoresearch-mlx

Apple Silicon (MLX) port of Karpathy's autoresearch — autonomous AI research loops on Mac, no PyTorch required.

delibae/claude-prism

An offline-first scientific writing workspace powered by Claude. LaTeX + Python + 100+ scientific skills all running locally.

signerlabs/Klee

A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.

finnvoor/yap

🗣️ A CLI for on-device speech transcription using Speech.framework on macOS 26

BitMiracle-AI/Dormice

The SQLite of agent sandboxes — self-hosted, E2B-compatible. One machine, sandboxes that live forever, idle costs nothing.

autonomous-ai/autonomous-computer

Own your compute, own your intelligence. Time to build your Personal AI Data Center.

Continuum-AI-Corp/OrcaRouter-Lite

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

incoai/splash

A local inference engine for Apple silicon, built around the model.

antoniorodr/cronboard

A terminal-based dashboard for managing cron jobs locally and on servers.

obsei/obsei

Open source, privacy-first Voice of Customer analytics. A self-hosted alternative to Enterpret and Unwrap that strips PII from feedback before any LLM sees it.

f/git-rewrite-commits

AI-powered git commit message rewriter using Ollama or GPT

callstackincubator/ai

On-device LLM execution in React Native with Vercel AI SDK compatibility

ayushsharma82/ESP-DASH

Blazing fast library to create a functional, on-device dashboard for ESP32, RP2040+W and RP2350+W microcontrollers

awaescher/OllamaSharp

The easiest way to use Ollama in .NET

joey-zhou/xiaozhi-esp32-server-java

小智ESP32的Java企业级管理平台，提供设备监控、音色定制、角色切换和对话记录管理的前后端及服务端一体化解决方案

techjarves/Uncensored-Local-AI-Multiplatform

A cross-platform Flutter app that runs uncensored, 100% offline open-source AI models (GGUF) directly on your Android, iOS, or PC. No cloud, no filters, total privacy.

ashhart/TensorFold

LLM Inference Engine for Metal and CUDA.

motdotla/node-lambda

Command line tool to locally run and deploy your node.js application to Amazon Lambda

Mahanaicoach/google-maps-scraper-kit

Google Maps scraper for lead generation, run by Claude Code. Exports clean CSVs with phones, emails, websites and socials. Local, free, no API keys.

ollaya-dev/ollaya

Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollama for decision models.

ik190/macos-chatgpt-overlay-bar

ChatGPT for Mac, living in your menubar.

DavidVentura/offline-translator

Use Firefox Translation Models for on-device translation on Android

rdiff-backup/rdiff-backup

Reverse differential backup tool, over a network or locally.

kairi003/Get-cookies.txt-LOCALLY

Get cookies.txt, NEVER send information outside.

0xSojalSec/LLMs-local

list of awesome platforms, tools, and resources run for LLMs locally

rudrankriyam/Foundation-Models-Framework-Lab

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

lmstudio-ai/mlx-engine

LM Studio Apple MLX engine

chongzhou96/EdgeSAM

Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"

NativeMindBrowser/NativeMindExtension

NativeMind: Your fully private, open-source, on-device AI assistant

Troyanovsky/Local-LLM-Comparison-Colab-UI

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

FrizzleM/SideInstaller

An an app that installs Sidestore on iOS 27, fully on-device

BruceMacD/chatd

Chat with your documents using local AI

perplexityai/numbat

Visibility into AI agent activity on endpoints, with on-device detection, optional pre-action blocking, and forensic reconstruction.

pepperoni21/ollama-rs

A simple and easy-to-use library for interacting with the Ollama API.

luigi311/JellyPlex-Watched

Sync watched status between jellyfin, plex and emby locally

meel-hd/lofi-engine

Generate LoFi music on the go, offline and locally.

facebookresearch/EdgeTAM

[CVPR 2025] Official PyTorch implementation of "EdgeTAM: On-Device Track Anything Model"

senstella/parakeet-mlx

An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.

dezoito/ollama-grid-search

A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.

eclaire-labs/eclaire

Local-first, open-source AI assistant for your data. Unify tasks, notes, docs, photos, and bookmarks. Private, self-hosted, and extensible via APIs.

TheStageAI/TheWhisper

Optimized Whisper models for streaming and on-device use

shubham0204/SmolChat-Android

Running any GGUF SLMs/LLMs locally, on-device in Android

Constella-OS/constella-desktop

Index all your local files + cloud apps privately, on-device with VectorDB & KnowledgeGraph in one

jjang-ai/vmlx

vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm

aphyr/tesser

Clojure reducers, but for parallel execution: locally and on distributed systems.

ml-explore/mlx-swift-lm

LLMs and VLMs with MLX Swift

jakobdylanc/llmcord

Make Discord your LLM frontend - Supports any OpenAI compatible API (OpenRouter, Ollama and more)

XHToken/Spark-X2.5

Spark-x2.5 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models

Blaizzy/mlx-audio-swift

A modular Swift SDK for audio processing with MLX on Apple Silicon

bstnxbt/dflash-mlx

Lossless DFlash speculative decoding for MLX on Apple Silicon

soupslurpr/Transcribro

Private and on-device speech recognition keyboard and service for Android.

madroidmaq/mlx-omni-server

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless

tikhop/TPInAppReceipt

Reading and Validating In App Purchase Receipt Locally.

aayushch/laya

Laya is an open-source, local-first AI notification command center that aggregates Slack, Gmail, GitHub, Jira, Notion, Outlook, Calendar (and more) notifications using local LLMs via Ollama and LM St

Picovoice/cheetah

On-device streaming speech-to-text engine powered by deep learning

OwlAIProject/Owl

A personal wearable AI that runs locally

lucasnewman/f5-tts-mlx

Implementation of F5-TTS in MLX

StartLuxLabs/StartLux-Decision

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.

timmyy123/LLM-Hub

Local LLM, image&video&music generator, run codex with local models on your phone

khanhduytran0/SparseBox

On-device toolbox?

otwld/ollama-helm

Helm chart for Ollama on Kubernetes

Sentient-OS-Labs/sentient-os

An on-device LLM understands your entire life, then proactively offers to get your work done through computer use.

Samsung/ONE

On-device Neural Engine

kapi2800/qwen3-tts-apple-silicon

Run Qwen3-TTS text-to-speech locally on Mac (M1/M2/M3/M4). Voice cloning, voice design, custom voices. 100% offline using MLX.

Mozilla-Ocho/Memory-Cache

MemoryCache is an experimental development project to turn a local desktop environment into an on-device AI agent

FaceAISDK/FaceRecognition_ReactNative

ReactNative on-device face verification, liveness detection, and face enrollment for Android and iOS.

psyray/oasis

Ollama Automated Security Intelligence Scanner

zblurx/dploot

DPAPI looting remotely and locally in Python

PrismML-Eng/Bonsai-Image-Demo

Generate images locally

NarimanN2/ollama-playground

Interesting LLM projects that I created for my YouTube channel using Ollama's open-source models.

getopenpost/openpost

Create, adapt, schedule, and track social posts. Open-source, hosted or self-hosted.

mclarkk/lifxlan

Python library for accessing LIFX devices locally using the official LIFX LAN protocol.

FluidInference/FluidUse

Local computer use on Apple silicon: on-device typed decisions with laya and form filling with CUA-S1-FORMS, driven through the macOS Accessibility API

Gremble-io/Detto

On-device meeting capture, dictation, and vault-native knowledge layer for macOS. Nothing leaves your Mac.

purcell/envrc

Emacs support for direnv which operates buffer-locally

AllYourBot/hostedgpt

An open version of ChatGPT you can host anywhere or run locally.

ollama4j/ollama4j

A simple Java library for interacting with Ollama server.

harperreed/photo-similarity-search

Super simple MLX (apple silicon) CLIP based photo similarity web app

EndoTheDev/Awesome-Ollama

An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.

carloslfu/slotstream

Run a 105 GB AI model on a Mac that can't hold it. Slotstream streams Qwen3.8-Flash-Next (125B mixture of experts) from your SSD and caches the busiest experts in memory, so it runs on Macs with 16 to

vorojar/Folio-OCR

Open-source batch OCR workbench — a free, local alternative to ABBYY FineReader. Powered by Ollama + GLM-OCR + PP-DocLayoutV3, ~0.5s/page on RTX 4090. Three-panel editor, layout-aware, PDF/image batch

lookr-fyi/job-application-bot-by-ollama-ai

The world’s #1 end-to-end job agent: semantic filters, ATS-optimized resumes, referrals from hiring managers — 100% hands-free.

mattt/ollama-swift

A Swift client library for interacting with Ollama. Supports structured outputs, tool use, and vision models.

ImDarkTom/LlamaPen

A no-install needed GUI for Ollama and other local LLM providers.

floci-io/floci-ui

Any Cloud. Locally - Web Console for the local Cloud (AWS, Azure, GCP and OCI)

Goekdeniz-Guelmez/mlx-lm-lora

Train Large Language Models on MLX.

binsentsu/home-assistant-solaredge-modbus

Home assistant Component for reading data locally from Solaredge inverter through modbus TCP

zeraix/zeraix

Open-source local AI workspace — advancing on-device inference.

forrany/Awesome-Ollama-Server

这是一个用于监控和检测 Ollama 服务可用性和性能的系统。它提供了一个现代化的 Web 界面，支持多语言（中文/英文），并具有实时检测和数据展示功能。

Desert-Ant-Labs/desert-ant-core

On-device AI SDKs for iOS, macOS, Android, and the web. Small, focused models that run fully offline in Swift, Kotlin, and JavaScript with Core ML, LiteRT, and WebAssembly.

mutonby/shortcast

Native macOS app: drop a long video → auto-cut viral shorts, captioned for TikTok/Reels/YouTube, reframed to vertical, and scheduled. 100% on-device (Gemma 4 12B + WhisperKit + MLX).

Hugo-Dz/on-device-transcription

A ready-to-use, minimal app that converts any speech into text.

dmtrKovalenko/subtitler

Free on-device web app for audio transcribing and rendering subtitles

oxiglade/mlx-rs

Unofficial Rust bindings to Apple's mlx framework

ByronLeeeee/Ollama-For-AMD-Installer

This project simplifies the installation process of likelovewant's library, making it easier for users to manage and update their AMD GPU-compatible Ollama installations.

taketwo/llm-ollama

LLM plugin providing access to models running on an Ollama server

ozantunca/locally

Locally is a localStorage manager that supports expirable items with timeout values and saves space by compressing them using LZW algorithm.

graniet/llm

A powerful Rust library and CLI tool to unify and orchestrate multiple LLM, Agent and voice backends (OpenAI, Claude, Gemini, Ollama, ElevenLabs...) with a single, extensible API. Build, chain, evalua

cubist38/mlx-openai-server

A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friend

leamsigc/ShortsGenerator

Automate the creation of Shorts content locally with a couple simple steps.

PocketRisu/PocketRisu

Self-hosted AI roleplay chat platform you run on your PC or personal server, forked from Risuai

cohesion-org/deepseek-go

Go SDK for DeepSeek V4 API — chat, reasoning, Anthropic-compatible endpoint, tool calling, FIM, and streaming. Also supports OpenRouter, Azure, Ollama, and OpenAI-compatible providers.

gergap/vim-ollama

Vim plugin for integrating Ollama based LLM (large language models)

reid41/QA-Pilot

QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.

QuantConnect/lean-cli

CLI for running the LEAN engine locally and in the cloud

eliautobot/my-virtual-office

A self-hosted 2D AI workspace for AI Agents

mfoud444/ollamafreeapi

OllamaFreeAPI: Free Distributed API for Ollama LLMs Public gateway to our managed Ollama servers with: - Zero-configuration access to 50+ models - Auto load-balanced across global nodes - Free tier w

msb-msb/awesome-local-ai

A curated list of resources for running AI locally on consumer hardware

perfectgf/lora-dataset-studio

Self-hosted, one-tab workbench for the whole training lifecycle: build Character/Concept/Style datasets (generate, scrape, or triage a big dump in the Image Bank), curate, caption, clean watermarks, t

VoltCyclone/PCILeechFWGenerator

Automatically generates custom pcileech firmware locally from real pcie devices

MateusRodCosta/SaveLocally

Save files locally via the share menu

dropbox/dropshots

Easy on-device screenshot testing for Android.

rasonyang/ai-native-callcenter

Self-hosted AI call center: AI talks, code controls the call. AI agents answer every call; humans take over without dropping it. Runs on FreeSWITCH with your SIP trunk and realtime model (OpenAI, Grok

orneryd/Mimir

Mimir - Fully open and customizable memory bank with semantic vector search capabilities for locally indexed files (Code Intelligence) and stored memories that are shared across sessions and chat cont

Goekdeniz-Guelmez/MLX-LoRA-Studio

A native Mac App for LLM fine-tuning on Apple Silicon — fully on-device, fully open source.

Vincent-Xi08/IntentRoute-AI

Open-source AI-assisted per-application routing for Windows with OpenAI/Ollama drafts and a sing-box TUN data plane.

noahfarr/rlx

A reinforcement learning framework based on MLX.

masterFoad/NanoSage

Local LLM Powered Recursive Search & Smart Knowledge Explorer

mrbizarro/Phosphene

Run MiniMax Hailuo H3 and LTX-2.5 video generation locally on a Mac. Joint audio+video, character LoRA training, one-click Pinokio install. MLX — no CUDA, no cloud, no API key.

Yenthe666/auto_backup

Automated database backups from Odoo, both locally and on an FTP server

rollroyces/py-idp

AI-enabled Intelligent Document Processing for Python: 12+ LLM backends, Pydantic schemas, self-hosted OCR (Nanonets-OCR2-3B), auto-schema discovery, HITL review, prod FastAPI server. AGPL-3.0 + comme

kuafuai/andee

An agent that moves into your Android phone and becomes its soul — not an assistant, not a tool. Any app, no integrations, on-device, one APK.

amirrezaDev1378/ollama-model-direct-download

Ollama model direct link generator and installer.

MassimilianoPasquini97/raycast_ollama

Raycast extention for Ollama

antranapp/awesome-mlx

p-lemonish/ollama-x-opencode

Step-by-step guide of how I setup opencode's agentic workflow to be compatible with ollama's models that are capable of using tools

ml-explore/mlx-c

C API for MLX

elastic/start-local

Try Elasticsearch and Kibana locally

nekomeowww/ollama-operator

🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫

moona3k/mlx-qwen3-asr

Qwen3-ASR speech recognition on Apple Silicon via MLX

crow-hq/llm-wiki-v2

Turn your documents into a Markdown wiki you can read, that answers with citations. Works with any LLM provider, Ollama included. CROW classifier routing: 89% right note vs 62%, 2.1× faster ingest, 68

mlx-graphs/mlx-graphs

Graph Neural Network library made for Apple Silicon

thewebAI/yolo-mlx

Nolan0722/TRAE-Ollama-Bridge

Encapsulate the local Ollama into an OpenAI-compatible API to bypass the fixed model limitations in IDEs like TRAE.

hanxiao/knowledge-graph-extractor

Turn any document or a whole zip into an interactive knowledge graph, using a self-hosted Qwen3.6-35B-A3B-MTP on a single NVIDIA L4

engeldlgado/toshllm

Run large language models locally on Intel Macs with AMD GPUs - native macOS app with Metal acceleration

tekumara/fakesnow

Run, mock and test fake Snowflake databases locally.

tryAGI/Ollama

Ollama SDK for .NET

MartinsMessias/deepsite-locally

DeepSite — AI website builder with local hosting support. Run DeepSite on your own server or offline.

BrakemanSmash/Airi-self-hosted-AI

⭐️ Download Airi Self-Hosted AI — powerful AI assistant software with setup installer v1.0. Includes activation keygen, license key pre-activated, full version serial, latest build Pro updated. Get de

EthanChan050430/Saki-Panel

Next-gen AI-native server ops panel with an in-workspace SRE agent. Crash self-healing, safe rollbacks, Docker/game servers, and local Ollama support.

kevinthedang/discord-ollama

Discord Bot that utilizes Ollama to interact with any Large Language Models to talk with users and allow them to host/create their own models.

anordin95/run-llama-locally

Run and explore Llama models locally with minimal dependencies on CPU

ferrumox/fox

A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefill

liyupi/openclaw-guide

开源OpenClaw中文文档站，OpenClaw中文指南，支持小龙虾 AI 智能体安装部署、消息渠道接入、Agent 架构、Skills 技能配置、模型提供商、CLI 命令参考、网关运维、安全沙箱等全方位文档。覆盖 WhatsApp、Telegram、Discord、飞书、钉钉、企业微信等 20+ 聊天平台，OpenAI、Anthropic、Ollama、通义千问等 30+ LLM 提供商，Doc

artcc/freelingo

Open-source, self-hosted AI language learning platform with local or cloud LLMs, CEFR study plans, an AI tutor, voice conversations, flashcards, and spaced repetition.

chrishrb/go-grip

Preview Markdown files locally before committing them.

mitsuhiko/pi-ds4

Run deepseek4 locally on metal right from within Pi

zce/weapp-locally

A locally app demo for wechat mini-program runtime.

suncityldp/zx-bench

A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.

converge-ai-labs/agent-foundation

a13n - An open-source library and self-hosted platform for building and running your own agent systems—with managed agents, memory, sandboxes, computer use, and durable execution. Commercial Friendly.

bitwize-ai/Logue

A local-first workspace for documents, tasks and meetings on macOS — nested spaces, typed properties, relations and saved views, with transcription, Smart Minutes and an agent running entirely on-devi

newdee/magpie

Spotlight-style local search for everything you saved and forgot: GitHub stars, local files, images, and bookmarks. Privacy-first, no full-disk scanning, fully on-device.

1runeberg/confichat

Lightweight, standalone, multi-platform, and privacy focused local LLM chat interface with optional encryption

elixir-nx/emlx

MLX Backend for Nx

WordPress/wordcamp.org

WordCamps are casual, locally-organized conferences covering everything related to WordPress.

QuangBK/localLLM_guidance

Local LLM ReAct Agent with Guidance

mzau/mlx-knife

ollama like cli tool for MLX models on huggingface (pull, rm, list, show, serve etc.)

tetsuo-ai/voice_clone_lab

Clone a voice from a few minutes of audio and generate speech locally — Qwen3-TTS fine-tuning pipeline with CLI and web UI

ocaml-mlx/mlx

OCaml .mlx syntax dialect with JSX syntax expressions

DDGTESTDEV-IONICS/ollama-gui-simple

'ollama gui windows' — A minimal local-LLM chat front-end: pick model, chat, switch — nothing else. Free, open community project for Windows.

mathiaschu/watch

Give Claude a video input. /watch downloads from YouTube/Instagram/X/Vimeo/any yt-dlp site, extracts frames, and transcribes locally with mlx-whisper — no API key. Fork of bradautomates/claude-video.

islet-project/islet

An on-device confidential computing platform

zatevakhin/obsidian-local-llm

Obsidian Local LLM is a plugin for Obsidian that provides access to a powerful neural network, allowing users to generate text in a wide range of styles and formats using a local LLM.

0xthirteen/AssemblyHunter

Find .net assemblies locally

matt-k-wong/mlx-flash

Flash weight streaming for MLX: run massive models larger than your RAM on Apple Silicon.

tegridydev/dnd-llm-game

MVP of an idea using multiple local LLM models to simulate and play D&D

rafaelmardojai/share-preview

Test social media cards locally

MuzeAnisichael/minimal-local-agent

Small local-first agent kernel: bounded tools, reversible edits, auditable runs. CLI + Web, Ollama + compatible APIs.

john-rocky/coreai-kit

Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download and caching, FoundationModels integration, and runnable examples with documented OS, SDK and

guoriyue/LangCommand

LangCommand is a local inference command-line tool that transforms natural language descriptions into shell commands.

gesta-run/subpool

A lightweight, self-hosted AI subscription pool for teams.

theguysudo/ENZO

Self-hosted AI workspace with agents, skills, and tools (Gmail, Calendar) that runs entirely on your own provider API keys (BYOK). Bring your own keys — Groq, OpenRouter, NVIDIA, Hugging Face, Google

benttega/ovo-local-llm

A private Claude-Code-style coding agent for Apple Silicon — run chat, code, and local model workflows on-device. MLX-native, Ollama/OpenAI API compatible, zero API keys.

opencomp-eu/ollama-ai-provider-v2

Vercel AI Provider for running LLMs locally using Ollama

duongngocbinh56599-ui/local-llm-lab

Honest local LLM deployment planning and benchmarking for high unified-memory Macs and future Linux/NVIDIA rigs.

iamwavecut/MLX-DLSS

NVIDIA DLSS 5 neural rendering and DLSS frame generation on Apple Silicon (MLX/Metal, Core ML) and PyTorch; weights extracted from your own DLSS libraries

Freim32/vllmops

Self-hosted vLLM made simple. Git-friendly YAML for models and profiles, full lifecycle from an intuitive CLI and TUI.

MichaelRabinovich/Scalable-Locally-Injective-Mappings

Implementation of 2D-parametrization algorithm introduced by the paper "Scalable Locally Injective Mappings". Currently support only the Symmetric Dirichlet isometric energy.

hsj576/virtual-ai-infra-team

An open-source virtual AI Infra team that discovers, benchmarks, and safely upgrades local LLM inference—with independent quality gates, a stable OpenAI-compatible API, and automatic rollback.

yibie/strata-mlx

Qwen3.8-Flash-Next on Apple Silicon: an MLX engine that reads Strata's GGUF files and speaks its line protocol (unofficial)

memovai/mimimodel

MimiModel: Agentic LLM on a $5 chip. 100% on-device. Private by design.

raullenchai/homebrew-rapid-mlx

Homebrew tap for Rapid-MLX — AI inference for Apple Silicon

deskmind-ai/deskmind

Small enough to run on your Mac. Smart enough to ask. An open-source computer use agent for macOS, with local models (MLX) that see, decide and act. 得心，应手。

todoforai/edge

Open-source AI agent that runs on your own computer and does your tasks. Any model (Claude, GPT, Gemini, Grok, Ollama), drives your real browser, shell, files, DOCX/XLSX.

ZimengXiong/Hunyuan3D-Swift

parity verified Hunyuan3D MLX runtime

SirUli/homeassistant-ollama-addon

A Home Assistant App (ex addon) to provide Ollama for AI

Noonkasymbolize/Airi-self-hosted-AI

⭐️ Download Airi Self-Hosted AI — powerful AI assistant software with setup installer v1.0. Includes activation keygen, license key pre-activated, full version serial, latest build Pro updated. Get de

petrukha-ivan/mlx-swift-structured

Structured output generation in Swift

magicnight/Mac-MLX

macMLX brings local LLM inference to Apple Silicon with a first-class native macOS experience. No cloud, no telemetry, no Electron — just your Mac running models at full speed.

komazarari/capistrano-locally

Capistrano plugin to simplify "localhost" deployment, without SSH-ing to localhost.

amazon-braket/amazon-braket-default-simulator-python

Quantum program simulators that can run locally

soniqo/speech-studio

Open-source desktop voice-cloning studio for creators — clone a voice, script lines with emotion markers, synthesize on-device. Tauri + VoxCPM2, runs on macOS, Windows, and Linux.

lichuang/semquery

Local document Q&A in your terminal — powered by on-device LLMs.

jesdga95/basalt

Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell

CrispStrobe/CrispEmbed

Lightweight text and scans processing: embedding, document processing, OCR, OMR, etc, with inference via ggml in pure C++

raullenchai/rapid-mlx-dsh-provider

Native Rapid-MLX provider for DeepSeek Harness (dsh) — dsh reads model facts from the server instead of your settings.yaml.

bnsd55/jevmlx

Jev-style parallel constrained decisions for any MLX model on Apple Silicon. Typed, schema-valid JSON in one forward pass.

AbuZar-Ansarii/PrivatePixelPrompt

PortableLM — Zero-dependency, air-gapped local AI that runs entirely from a USB drive. Chat, generate images, and synthesize speech offline on Windows, macOS, or Linux. No installs, no internet, just

PuddinCat/OllamaSpider

自动扒拉Ollama API!

warm3snow/vscode-ollama

vscode-ollama extension supporting chat、web browsing etc.

rudrankriyam/Core-AI-Framework-Lab

A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device inference.

ollama/ollama-vscode

Official Ollama Extension for VS Code

zouyee/dmlx

Big models. Small Macs. Zero excuses.

sygnalinc/Apple-Frameworks-for-TouchDesigner

Apple's on-device frameworks (Vision, Core ML, RealityKit, SpeechAnalyzer, MLX ...) as native TouchDesigner operators. macOS / Apple Silicon.

nyc-esq/hey-donut

A custom "Hey Donut" wake word for Home Assistant — 62 KB, runs on-device, zero false accepts per hour. Includes the full training pipeline so you can teach your assistant any name. CC0.

noorgx/gamepass-search

Desktop app for browsing and filtering the Xbox Game Pass catalog with on-device AI genre classification

midagedev/mwoyeo

Live, in-place screen translation for macOS — a lens that rewrites the text under it in your language, on-device.

Incept5/mlxchat

A ChatGPT-like app using Alibaba's Qwen3.5 models locally on the phone - with tool calling & vision

stevyhacker/LokalBot

A local LLM workhorse that keeps a memory of your workday. On-device meeting notes, dictation, autocomplete, and recall for macOS. GPLv3.

alpine-docker/ollama

Minimal CPU-only Ollama Docker Image

kingabzpro/using-llama3-locally

Running llama3 using Ollama-Python, Curl, LangChain, Chroma, and User interface.

cyyself/OpenTihui

on-device LLM for iOS with keyboard shortcuts

lichuang/docq

Local document Q&A in your terminal — powered by on-device LLMs.

SohniSwatantra/autoresearch-local-llm