on-device

There are 11 repositories under on-device topic.

• mozilla / DeepSpeech

  DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

  deep-learningmachine-learningneural-networkstensorflowspeech-recognitionspeech-to-textdeepspeechembeddedon-deviceoffline
  Language:C++ 26594

• Picovoice / porcupine

  On-device wake word detection powered by deep learning

  wake-word-detectionhotwordkeyword-spottingkeyword-spotterwake-wordwake-word-enginehandsfreehotword-detectionhotword-detectoron-devicespeech-recognitiontrigger-word-detectionvoice-activation
  Language:Python 4377

• NexaAI / Awesome-LLMs-on-device

  Awesome LLMs on Device: A Comprehensive Survey

  awesomeawesome-listllmon-device
  1201

• Picovoice / rhino

  On-device Speech-to-Intent engine powered by deep learning

  natural-language-understandingvoice-recognitionnluspoken-language-understandingvoice-assistantvoice-uivoice-user-interfacespeech-recognitionvoice-commandsvoice-controlvuion-devicesluentity-resolutionintent-inferenceslot-fillingvoice-commandvoice-command-control
  Language:Python 680

• Picovoice / picovoice

  On-device voice assistant platform powered by deep learning

  voice-recognitionspeech-recoginitionvoice-assistantvoice-interfacevoice-user-interfacenatural-language-understandingnluon-devicevoice-commandvoice-commandswake-word-detection
  Language:Python 668

• Picovoice / leopard

  On-device speech-to-text engine powered by deep learning

  sttspeech-to-textasrautomatic-speech-recognitionon-devicespeech-recognitiontranscriptionvoice-recognitionvoice-to-text
  Language:Python 458
• aub.ai

  BrutalCoding / aub.ai

  AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

  androiddartfluttergen-aiiosipadoslinuxllamacppmacosmistral-7bnative-appspubdevlocalllamanlpon-device-aigeminion-devicegemini-nanogenaiindiedev
  Language:Dart 302

• Picovoice / cobra

  On-device voice activity detection (VAD) powered by deep learning

  voice-activity-detectionspeech-recognitionvadon-devicevoice-activityvoice-activity-detector
  Language:Python 228

• PTEz / LumberjackConsole

  On-device CocoaLumberjack console with support for search, adjust levels, copying and more.

  cocoalumberjackconsoledashboardlogon-devicenbuloglog-levelios
  Language:Objective-C 202

• bd4sur / Nano

  电子鹦鹉 / Toy Language Model

  aigptllmllm-inferencellm-trainingon-deviceon-device-aitransformer
  Language:C 198
• DNAnalyzer

  VerisimilitudeX / DNAnalyzer

  Precision genomics for everyone, everywhere. Powered by private AI.

  bioinformaticsdna-sequencingregulatory-elementsgenomicsartificial-intelligencemachine-learningcomputational-biologybiotechnologyclidna-analysisfastaon-deviceopen-sourceprecision-medicineprivacy
  Language:HTML 161

• tucan9389 / PoseEstimation-TFLiteSwift

  The baseline project for inferencing various Pose Estimation tflite models with TFLiteSwift on iOS

  tensorflowiostensorflow-liteopenposeposenetsimpleposecpmhourglassmobilenetv23d-pose-estimationon-devicepose-matchingtflite
  Language:Swift 155
• convmelspec

  adobe-research / convmelspec

  Convmelspec: Convertible Melspectrograms via 1D Convolutions

  aiaudioconversioncoremlmlon-deviceonnxcoremltoolsmilspectrogramsmelspectrogramsdeep-learningmachine-learningpytorch
  Language:Python 145

• Picovoice / koala

  On-device noise suppression powered by deep learning

  noise-cancellationnoise-reductionnoise-suppressionon-devicepicovoicespeech-enhancement
  Language:Python 74

• aqibsaeed / On-device-activity-recognition

  Personalized machine learning on the smartphone

  on-devicedeep-learningsensor-fusionactivity-recognitionandroidtranfer-learning
  Language:Java 59

• Natxo09 / Eris.

  Eris is a private AI chat application that runs entirely on your device using Apple's MLX framework. Named after the dwarf planet that challenged our understanding of the solar system, Eris challenges the notion that AI must live in the cloud.

  aiassistantchatchatbotgptllamallmlocalmlxofflineon-deviceprivacyprivatesecure
  Language:Swift 56

• Picovoice / falcon

  On-device speaker diarization powered by deep learning

  speaker-diarizationdeep-learningdiarizationon-devicespeaker-recognition
  Language:Python 53

• JaeBinCHA7 / Nested-U-Net-based-Real-time-Speech-Enhancement-Mobile-App

  Real-time speech enhancement mobile app using Nested U-Net

  noise-reductionnoise-removalspeechspeech-enhancespeech-enhancementspeech-processingandroid-tensorflowreal-timerealtimetensorflow-liteedge-computingedge-deviceson-device
  Language:Python 52
• jesture-sdk

  jesture-ai / jesture-sdk

  Official repo for Jesture AI SDK: Real-time On-device Hand Gesture Control

  jestureaijesture-sdkhand-gesturesgesture-controlhand-trackingreal-timegesturesgestures-recognitionon-devicehand-gesture-recognition
  Language:Python 52

• DaemonLoki / MyAppleIntelligence

  Custom implementation of Apple Intelligence features

  aiappleapple-intelligencecoremlcoreml-frameworkllama3mlx-swifton-deviceon-device-aistable-diffusionswiftswift-transformers
  Language:Swift 44

• keenresearch / KeenASR-Android-PoC

  A proof-of-concept app using KeenASR SDK on Android. WE ARE HIRING: https://keenresearch.com/careers.html

  speech-recognitionvoice-recognitionvoice-controlvoice-commandsvoice-chatvoice-assistantspeechspeech-to-textspeech-to-text-androidon-deviceoffline
  Language:Java 28

• MiniAiLive / FaceLivenessDetection-SDK-Docker

  iBeta (Level 2) Certified, Single-Image Based Face Liveness Detection (Face Anti Spoofing) Server SDK

  age-gender-estimationandroid-sdkattendance-systemauthenticationbiometricsface-alignmentface-anti-spoofingface-detectionface-livenessface-matchingface-recognitionface-trackingkyc-serviceliveness-detectionnist-frvton-deviceon-premisepassive-livenessverificationibeta
  Language:Python 21

• context-sdk / context-sdk-releases

  Real-world context insights SDK for Swift apps, enhancing user experience and engagement with a privacy-first approach

  coremlioson-deviceprivacyspmswift
  Language:Swift 16

• Q2-Development / q2-edge-chat

  Chat with on-device LLM's on iPhone

  iosiphonellmon-device
  Language:Swift 15

• RiS3-Lab / ShadowNet

  Open-source code and data for ShadowNet(S&P Oakland'23)

  gpuinferencemlmodelon-devicesecure
  Language:Java 11

• arghyasur1991 / Spark-TTS-Unity

  Unity package for using Spark-TTS on-device models. This is a C# port of https://github.com/SparkAudio/Spark-TTS by SparkAudio team and uses converted ONNX models instead of the PyTorch models in the original repo

  on-deviceonnxonnxruntimesparkttsttsunitymachine-learningtexttospeechvoicevoice-assistantvoicecloningaiartificial-intelligenceios
  Language:C# 10
• DA2Lite

  da2so / DA2Lite

  DA2Lite is an automated model compression toolkit for PyTorch.

  pruningfilter-decompositionpythonon-devicepytorchmodel-compressiondeep-learningknowledge-distillationquantizationmodel-optimizationimage-classification
  Language:Python 9

• Otosaku / OtosakuKWS-iOS

  Lightweight on-device keyword spotting engine for iOS using CoreML and real-time audio streaming.

  audiocoremlioskeyword-spottingkwsmachine-learningon-devicereal-timesignal-processingspeech-recognitionswiftwakeword
  Language:Swift 8

• estellekao / EE292D_Project

  Adaptive Fall Detection on the Edge using MobiAct dataset

  on-devicetraining
  Language:Python 7

• context-sdk / react-native

  Real-world context insights SDK for React Native apps, enhancing user experience and engagement with a privacy-first approach

  coremlioson-deviceprivacyreact-native
  Language:TypeScript 4

• keenresearch / keenasr-swift-poc

  Proof-of-concept app that showcases use of KeenASR SDK in a Swift app. WE ARE HIRING: https://keenresearch.com/careers.html

  speech-recognitionspeechvoice-recognitionvoice-commandsvoice-controlspeech-to-textvoice-assistantvoice-chaton-deviceoffline
  Language:Objective-C 4

• rishabh01solanki / PixeLearner

  Combining the power of MobileNetV2 with the privacy of on-device learning. Benefit from real-time updates and efficient image processing, all while ensuring your data remains securely on your device. Experience precision, speed, and trust with PixeLearner.

  coreml-modelscoreml-visiondeep-learningon-devicepytonswiftupdatable-model
  Language:Swift 4

• chakkritte / PKD

  [IEEE TII] On-Device Saliency Prediction Based on Pseudoknowledge Distillation

  deep-learningsaliency-predictionknowledge-distillationpseudo-labelon-devicepseudoknowledge-distillation
  Language:Python 3

• hissain / AndroidSemanticSearch

  A minimalistic Android app showcasing semantic search using ObjectBox and Lucene KNN, leveraging the MiniLM-L6-V2 embedding model and bert_vocab.txt for efficient retrieval.

  androidlucenelucenesearchmachine-learningminimalon-deviceon-device-aion-device-mlsemantic-searchvector-databasebert-vocabsminilm-l6-v2objectboxobjectbox-android
  Language:Jupyter Notebook 3

• arghyasur1991 / LiveTalk-Unity

  LiveTalk is a unified, high-performance talking head generation system that combines the power of LivePortrait and MuseTalk open-source repositories. The PyTorch models from these projects have been ported to ONNX format and optimized for CoreML to enable efficient on-device inference in Unity.

  avatarcharacter-generatorcoremlliveportraitmusetalkonnxonnxruntimetalking-headttsunityon-devicedigital-humanunity-packageunity3daiartificial-intelligencemachine-learning
  Language:C# 2

• BoltUIX / TFLite-Text-Classifier-Android-App

  This Android app leverages a TensorFlow Lite model for on-device classification of social media posts into 11 categories, including technology, sports, finance, and more. Built with Kotlin and Jetpack Compose, it ensures efficient, privacy-focused inference without server dependencies.

  aiandroidappdevcolab-notebookjetpack-composejetpackcomposekotlinmachine-learningmobile-appnlpon-devicetensorflowtensorflow-litetext-classificationtflitetflite-modelstips-and-tricks
  Language:Jupyter Notebook 2