TinyML & Edge AI: On-device inference, model quantization, embedded ML, ultra-low-power AI for microcontrollers and IoT devices.
AI for Apple silicon devices.
Auditable offline edge intelligence for low-cost edge devices, with benchmark evidence and public board proof on ESP32-C3.
Flutter starter example app to get started with NobodyWho, a library designed to run LLMs locally and efficiently on any device.
The Private Agent OS — search files, run AI agents, connect to 10,000+ tools via the complete protocol stack (MCP, AG-UI, A2UI, A2A). Zero cloud. Zero telemetry. On-device inference.
React Native starter example app to get started with NobodyWho, a library designed to run LLMs locally and efficiently on any device.
Custom llama.cpp fork with character intelligence engine: control vectors, attention bias, head rescaling, attention temperature, fast weight memory
iOS + Android app that runs local LLMs on-device + routstr cloud LLMs for anonymous inference
Mobile AI: iOS CoreML, Android TFLite, on-device inference, ONNX, TensorRT, and ML deployment for smartphones.
High-performance Android SDK for on-device LLM inference (GGUF). Privacy-focused, offline-first, and powered by llama.cpp with a clean Kotlin Coroutines API.
Production Android AI with ExecuTorch 1.0 - Deploy PyTorch models to mobile with NPU acceleration and 50KB footprint
Unofficial Swift SDK for Google's LiteRT-LM — run Gemma 4 on-device with text, vision, audio, and tool calling. CPU + GPU (Metal). iOS 17+ / macOS 14+.
On-device AI inference for Swift apps. Run LLMs locally on iOS, macOS, visionOS and watchOS.
Neural acoustic echo cancellation for Apple platforms using CoreML — Swift package with 128/256/512-unit DTLN-aec models
iOS & macOS starter example apps to get started with NobodyWho, a library designed to run LLMs locally and efficiently on any device.
Swift wrapper for Apple's BNNS graph API — run compiled CoreML models (.mlmodelc) on CPU with zero-copy buffer management
React Native SDK for local LLM inference and on-device AI on iOS and Android.
Ad generation via offline LLMs with on-device inference, optionally managed by a self-hosted CMS.
Add a description, image, and links to the on-device-inference topic page so that developers can more easily learn about it.
To associate your repository with the on-device-inference topic, visit your repo's landing page and select "manage topics."