Riccorl

mistral.rs

Blazingly fast LLM inference.

beanis

Asynchronous Python ODM for Redis

foundation-model-stack

🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

granite-code-models

Granite Code Models: A Family of Open Foundation Models for Code Intelligence

fastfetch

Like neofetch, but much faster because written mostly in C.

llm.c

LLM training in simple, raw C/CUDA

mwparserfromhell

A Python parser for MediaWiki wikicode

uv

An extremely fast Python package installer and resolver, written in Rust.

OpenVoice

Instant voice cloning by MyShell.

torchtitan

A native PyTorch Library for large model training

cohere-toolkit

Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.

corenet

CoreNet: A library for training deep neural networks

torchtune

A Native-PyTorch Library for LLM Fine-tuning

fms-fsdp

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

lit

Lit is a simple library for building fast, lightweight web components.

raft

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

upscayl

🆙 Upscayl - #1 Free and Open Source AI Image Upscaler for Linux, MacOS and Windows.

research-career-tools

examples

Fast and flexible reference benchmarks

streaming

A Data Streaming Library for Efficient Neural Network Training

megablocks

Qwen

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

qdrant

Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

litdata

Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.

lightning-thunder

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

fsdp_qlora

Training LLMs with QLoRA + FSDP

lm-evaluation-harness

A framework for few-shot evaluation of language models.

LeetCode-Questions-CompanyWise

Contains Company Wise Questions sorted based on Frequency and all time

llm_training_handbook

An open collection of methodologies to help with successful training of large language models.

ChatRTX

A developer reference project for creating Retrieval Augmented Generation (RAG) chatbots on Windows using TensorRT-LLM