on-device-ai
There are 4 repositories under on-device-ai topic.
NexaAI / nexa-sdk
On device AI inference in minutes—now for MLX & GGUF and Qualcomm NPU, with Android and iOS coming soon.
Language:Go 4785QiuYannnn / Local-File-Organizer
An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.
Language:Python 2549mit-han-lab / proxylessnas
[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
Language:C++ 1437chongzhou96 / EdgeSAM
Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"
Language:Jupyter Notebook 1058TinyChatEngine: On-Device LLM Inference Library
Language:C++ 894AnyLifeZLB / FaceVerificationSDK
Android on_device 1:1 Face Recognition 、 Liveness detection and 1:N & M:N Face Search SDK 🧒 离线版设备端Android1:1人脸识别 动作活体、静默活体、近红外双目活体检测 以及1:N M:N 人脸搜索算法SDK 封装。全程可开飞行模式不用联网
Language:Java 700- ONELanguage:C++ 458
[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices
Language:Python 445gkonovalov / android-vad
Android Voice Activity Detection (VAD) library. Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.
Language:C 408Hugo-Dz / on-device-transcription
A ready-to-use, minimal app that converts any speech into text.
Language:JavaScript 375- aub.ai
BrutalCoding / aub.ai
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
Language:Dart 302 woheller69 / whisperIME
Android Input Method Editor (IME) based on Whisper
Language:Java 247- Language:C 198
xliucs / MTTS-CAN
Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (NeurIPS 2020)
Language:Python 195[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices
Language:Python 165hollance / coreml-training
Source code for my blog post series "On-device training with Core ML"
Language:Jupyter Notebook 101Picovoice / pico-cookbook
Recipes for on-device voice AI and local LLM
Language:Python 80ubicomplab / rppg-web
This is a web demo for camera-based PPG sensing (rPPG).
Language:TypeScript 75neuralize-ai / edgerunner
Simplified AI runtime integration for mobile app development
Language:C++ 65Binary Neural Network on IceStick FPGA.
Language:Jupyter Notebook 51DaemonLoki / MyAppleIntelligence
Custom implementation of Apple Intelligence features
Language:Swift 44Kotlin bindings for Edgerunner
Language:Kotlin 30roboflow / inference-server-old
Object detection inference with Roboflow Train models on NVIDIA Jetson devices.
Language:JavaScript 13- mytag
cryptoboid / mytag
A Google Photos alternative, where your pictures never leave your phone! Classification happens on-device, leveraging pre-trained models. Available for Android and iOS.
Language:JavaScript 12 baochuquan / ios-vad
iOS Voice Activity Detection (VAD). Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.
Language:Swift 11- Language:TypeScript 7
- Language:C++ 6
Nokia-Bell-Labs / data-channel-extension
[NeurIPS'24] DEX: Data Channel Extension for Efficient CNN Inference on Tiny AI Accelerators
Language:Jupyter Notebook 6Michaelgathara / gemini-rec-search
Rediscover the web by browsing the web and get recommendations of new webpages to explore - powered by Gemini Nano
Language:TypeScript 5abhishekk962 / redact
R.E.D.A.C.T (Restricting Exposed Data by Anonymization for Confidential Transmission) is an Electron-based application that helps you redact personal information from text documents and clipboard content.
Language:JavaScript 3Dcom-KHU / AEye-Android
2022 D.Com 동아리 대항전 Team "AEye" - Android Native App 개발을 위한 Repo.
Language:Kotlin 3hav4ik / eyesight
A python framework for designing high-performance Computer Vision pipelines at the Edge. Supports Coral Edge TPU, Raspberry Pi Camera, and more.
Language:Python 3luix / SponsorMe
SponsorMe is a project to help provide access to digital tools for learning, powered by on-device machine learning, innovation and willingness, to those people that have limited access to technology due to demographics, disabilities, economy or other multiple reasons.
Language:Kotlin 2RionDsilvaCS / research-assistant-rag-fusion
This project implements a complete offline RAG-Fusion application for text generation and retrieval, leveraging efficient local resources.
Language:Python 2azuregray / ODIA-Agentic-Interface
An On-Device completely offline personal AI Agent that has both user interface and an always-active kernel-level interface that can interact with the programs you write and the apps you run.
