romitjain

awesome-selfhosted

A list of Free Software network services and web applications which can be hosted on your own servers

annotated_deep_learning_paper_implementations

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

OpenVoice

Instant voice cloning by MIT and MyShell.

awesome-tmux

A list of awesome resources for tmux

moshi

sshfs

A network filesystem client to connect to SSH servers

lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

WhisperSpeech

An Open Source text-to-speech system built by inverting Whisper.

agents

Build real-time multimodal AI applications 🤖🎙️📹

gpu.cpp

A lightweight library for portable low-level GPU computation using WebGPU.

stable-diffusion.cpp

Stable Diffusion and Flux in pure C/C++

Liger-Kernel

Efficient Triton Kernels for LLM Training

awesome-tensor-compilers

A list of awesome compiler projects and papers for tensor computation and deep learning.

ao

PyTorch native quantization and sparsity for training and inference

flashinfer

FlashInfer: Kernel Library for LLM Serving

LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

MobileLLM

MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.

awesome-o1

A bibliography and survey of the papers surrounding o1

hqq

Official implementation of Half-Quadratic Quantization (HQQ)

GPTFast

Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.

Pytorch-VAE-tutorial

A simple tutorial of Variational AutoEncoders with Pytorch

LMCache

Ultra-Fast and Cheaper Long-Context LLM Inference

Awesome_LLM_System-PaperList

Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of papers on accelerating LLMs, currently focusing mainly on inference acceleration, and related works will be gradually added in the future. Welcome contributions!

applied-ai

Applied AI experiments and examples for PyTorch

webdataset-lightning

A small demonstration of using WebDataset with ImageNet and PyTorch Lightning

audiotoken

Audio tokenization, in the fastest way possible!

kernels

vllmini

A minimal implementation of vllm.

webdataset-imagenet-2

A small repository demonstrating the use of Webdataset and Imagenet