Yan Ru Pei's starred repositories
pytorch_stoi
STOI loss function in PyTorch
geocode_rocks
a python script for geocoding boulder and roped problems
torch-pesq
PyTorch implementation of the Perceptual Evaluation of Speech Quality for wideband audio
flash-attention
Fast and memory-efficient exact attention
Awesome-Mamba-Papers
Awesome Papers related to Mamba.
eye_track_spatiotemporal
A lightweight spatio-temporal network for online eye tracking with event camera
mamba-tiny
Simple, minimal implementation of the Mamba SSM in one pytorch file. More efficient than using for loops, but probably less efficient than using associative scans
Loop-Algorithm
An algorithm for generating hard RBM instances
heinsen_sequence
Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)
pytorch-cppcuda-tutorial
tutorial for writing custom pytorch cpp+cuda kernel, applied on volume rendering (NeRF)
torch-discounted-cumsum
Fast Discounted Cumulative Sums in PyTorch
resume-chatbot
A chatbot for recruiters to query information about a job applicant
nuplan-devkit
The devkit of the nuPlan dataset.
youtube-bb
Public repo for helpful scripts when using the YouTube Bounding Boxes dataset
waymo-open-dataset
Waymo Open Dataset
RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
National_interest_waiver_waittime
USCIS Employment-based-2 national interest waiver wait time