Ar57m's starred repositories
StreamDiffusion
StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation
another_fractal_generator
Fractal generator in C++ and python
random_tools
Testing Random Things
OnnxStream
Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.
Stable-Diffusion-Android
Stable Diffusion AI client app for Android
tts-util-app
TTS Util — Text-to-speech utility Android app for synthesising text into audible speech
sherpa-onnx
Speech-to-text, text-to-speech, and speaker recognition using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, Raspberry Pi, RISC-V, x86_64 servers, websocket server/client, C/C++, Python, Kotlin, C#, Go, NodeJS, Java, Swift, Dart, JavaScript, Flutter
lite.koboldai.net
A zero dependency web UI for KoboldAI Horde
Stable-Diffusion-Android
Stable Diffusion AI client app for Android
gguf-tools
Some random tools for working with the GGUF file format
LLM-Shearing
[ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference
RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
termux-packages
A package build system for Termux.
termux-app
Termux - a terminal emulator application for Android OS extendible by variety of packages.
PerroPastor
Run Llama based LLMs in Unity entirely in compute shaders with no dependencies