zhuzilin

ring-flash-attention

Ring attention implementation with flash attention

whisper-openvino

openvino version of openai/whisper

faster-nougat

Implementation of nougat that focuses on processing pdf locally.

pdf-with-its-own-md5

A PDF template that contains its own MD5!

es

A JavaScript interpreter from scratch, supporting ES5 syntax.

chatgpt-desktop

Desktop version of ChatGPT, support manually set cookie

vllm-group

aqt-pytorch

wandb-discord-bot

A discord bot for monitoring wandb project and runs.

blog

my blog~

llama

Inference code for LLaMA models

torchrec_mapper

zhuzilin

electron-fc

A electron based famicom(NES) emulator

flash-attention

Fast and memory-efficient exact attention

OpenRLHF

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

scattermoe

Triton-based implementation of Sparse Mixture of Experts.

triton

Development repository for the Triton language and compiler

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

base64-img

bun

Incredibly fast JavaScript runtime, bundler, transpiler and package manager – all in one.

FBGEMM

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

grouped_gemm

PyTorch bindings for CUTLASS grouped GEMM.

instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

megablocks

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

torchrec

Pytorch domain library for recommendation systems

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.