EricLBuehler

mistral.rs

Blazingly fast LLM inference.

candle-vllm

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

diffusion-rs

Blazingly fast inference of diffusion models.

float8

8-bit floating point types for Rust

candle_graphs

Graph model execution API for Candle

candle

Minimalist ML framework for Rust

edge-u-cation

Edge(u)cation: Cutting-edge multimodal LLMs on the edge with mistral.rs, using F8Q8

uqff_maker

Automated generation of UQFF models with mistral.rs.

dora

DORA (Dataflow-Oriented Robotic Application) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.

Graph-Aware-Transformers

Graph-Aware Attention for Adaptive Dynamics in Transformers

candle-flash-attn-v3

llguidance

Super-fast Structured Outputs

minijinja

MiniJinja is a powerful but minimal dependency template engine for Rust compatible with Jinja/Jinja2

mlx

MLX: An array framework for Apple silicon

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

cpython

The Python programming language

EricLBuehler

cudarc

Safe rust wrapper around CUDA toolkit

kalc

a complex numbers, 2d/3d graphing, arbitrary precision, vector, cli calculator with real-time output

llama_index

LlamaIndex is a data framework for your LLM applications

loc

Count lines of code quickly.

mirage

A multi-level tensor algebra superoptimizer

PyParser

ratchet

A cross-platform browser ML framework.

rust

Rust Programming Language

RustPython

A Python Interpreter written in Rust

tch-rs

Rust bindings for the C++ api of PyTorch.

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

triomphe

Fork of std::sync::Arc with lots of utilities useful for FFI

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs