offline-inference

There are 0 repository under offline-inference topic.

dineshsoudagar / local-llms-on-android
Run large language models like Qwen and LLaMA locally on Android for offline, private, real-time question answering and chat - powered by ONNX Runtime.
android local-llm local-llm-integration onnx-runtime android-app chatbot huggingface-tokenizers llama3 mobile-ai offline-inference on-device-ai qwen
Language:Kotlin 56
iBz-04 / offeline
run llms and slms on your hardware & browser
electron-app llamacpp local-ai node-llama-cpp ollama-app webgl webgpu inference-engine offline-inference on-device-ai ondeviceai quantizedai privacy-enhancing-technologies privateai
Language:TypeScript 13
brotSchimmelt / llm-offline-inference
A comprehensive toolkit for streamlining and simplifying the offline inference process for LLMs across various models and libraries.
batching llm llm-inference offline-inference structured-generation
Language:Python
JIoccb / ecup-counterfeit-classifier
Мультимодальная офлайновая система детекции контрафакта (текст+изображение+таблица).
clip counterfeit-detection docker multimodal ocr offline-inference pytorch scikit-learn tesseract transformers
Language:Python

dineshsoudagar / local-llms-on-android