zhuzilin

ring-flash-attention

Ring attention implementation with flash attention

whisper-openvino

openvino version of openai/whisper

pdf-with-its-own-md5

A PDF template that contains its own MD5!

es

A JavaScript interpreter from scratch, supporting ES5 syntax.

chatgpt-desktop

Desktop version of ChatGPT, support manually set cookie

pytorch-malloc

An external memory allocator example for PyTorch.

NeZha

Organizing ssh servers in one shell.

wandb-discord-bot

A discord bot for monitoring wandb project and runs.

ecdh-psi

A Go Implementation of ECDH-PSI

blog

my blog~

torchrec_mapper

zhuzilin

bfc

A really fast non-JIT brainfuck interpreter.

electron-fc

A electron based famicom(NES) emulator

llama

Inference code for LLaMA models

nvcc_daxpy_example

base64-img

bun

Incredibly fast JavaScript runtime, bundler, transpiler and package manager – all in one.

chibicc

A small C compiler

DeeperSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

DeepSpeedExamples

Example models using DeepSpeed

FBGEMM

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

flash-attention

Fast and memory-efficient exact attention

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

instruct-eval

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

PatrickStar

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

qiskit-translations

Home of Qiskit documentation translations

torchrec

Pytorch domain library for recommendation systems

triton

Development repository for the Triton language and compiler