darxkies

lm.rs

Minimal Gemma inference code in Rust

llm-samplers

A collection of LLM token samplers in Rust

ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

image-png

PNG decoding and encoding library in pure Rust

ginger

Ginger is a stand-alone editor for LLM character cards.

cake

Distributed LLM and StableDiffusion inference for mobile, desktop and server.

maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models.

GraphRAG-Local-UI

GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app.

xtts-api-server

A simple FastAPI Server to run XTTSv2

llm_client

Rust library for integrating local LLMs (with llama.cpp) and external LLM APIs.

espeaker

sherpa-rs

Rust bindings to https://github.com/k2-fsa/sherpa-onnx

ebook-groupchat

ebook-to-chatml-conversion

idea: https://github.com/nyxkrage/ebook-groupchat/

screenpipe

Library to build personalized AI powered by what you've seen, said, or heard. Works with Ollama. Alternative to Rewind.ai. Open. Secure. You own your data. Rust.

Nova

An Open-Source Modular AI Assistant

inneal

Inneal is an LLM chatbot/roleplay client for the AI Horde, built with SwiftUI and SwiftData

lyzr-automata

low-code multi-agent automation framework

rust-openssl

OpenSSL bindings for Rust

tortoise.cpp

A ggml (C++) re-implementation of tortoise-tts

gppm

GPU Power and Performance Manager

WilmerAI

A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to many backend connections to LLMs, allowing one AI Assistant to be powered by many models.

IMS-Toucan

Multilingual and Controllable Text-to-Speech Toolkit of the Speech and Language Technologies Group at the University of Stuttgart.

LLM101n

LLM101n: Let's build a Storyteller

agdb

Agnesoft Graph Database

rust-html2text

Rust library to render HTML as text.

Samba

Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"

pdf-extract

A rust library for extracting content from pdfs

pdfium-render

A high-level idiomatic Rust wrapper around Pdfium, the C++ PDF library used by the Google Chromium project.

metavoice-src

Foundational model for human-like, expressive TTS