apepkuss

server-assistant

wasi-logging

WASI logging API

AiR

AI with Rust.

docs

neovim

Vim-fork focused on extensibility and usability

whisper-api-server

mistral.rs

Blazingly fast LLM inference.

luminal

Deep learning at the speed of light.

rag-api-server

A RAG API server written in Rust following OpenAI specs

ChatTTS

A generative speech model for daily dialogue.

wasi-logger

A `log::Log` implementation for WASM components backed by the `wasi:logging/logging` WIT interface.

log

Logging implementation for Rust

gaianet-node

Install and run your own AI agent service

freya

Cross-platform GUI library for 🦀 Rust powered by 🧬 Dioxus and 🎨 Skia.

crabml

a fast cross platform AI inference engine 🤖 using Rust 🦀 and WebGPU 🎮

qdrant

Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

rust-client

Rust client for Qdrant vector search engine

WASI-NN-GGML-PLUGIN-REGISTRY

This is a registry project for storing all released WasmEdge WASI-NN GGML plugin with different llama.cpp versions.

text-splitter

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.

makepad

Makepad is a creative software development platform for Rust that compiles to wasm/webGL, osx/metal, windows/dx11 linux/opengl

mewz

A unikernel designed specifically for running Wasm applications and compatible with WASI

LlamaEdge

The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

mlx

MLX: An array framework for Apple silicon

setuptools-rust

Setuptools plugin for Rust support

cxx

Safe interop between Rust and C++

autocxx

Tool for safe ergonomic Rust/C++ interop driven from existing C++ headers

maturin

Build and publish crates with pyo3, cffi and uniffi bindings as well as rust binaries as python packages

Local-LLM-Comparison-Colab-UI

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

streamlit-chatgpt

A ChatGPT like app using Streamlit.

chatbot-ui

AI chat for every model.