Rahul Vast's starred repositories
vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
DALLE2-pytorch
Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
The-Complete-FAANG-Preparation
This repository contains all the DSA (Data-Structures, Algorithms, 450 DSA by Love Babbar Bhaiya, FAANG Questions), Technical Subjects (OS + DBMS + SQL + CN + OOPs) Theory+Questions, FAANG Interview questions, and Miscellaneous Stuff (Programming MCQs, Puzzles, Aptitude, Reasoning). The Programming languages used for demonstration are C++, Python, and Java.
wait-for-it
Pure bash script to test and wait on the availability of a TCP host and port
denoising-diffusion-pytorch
Implementation of Denoising Diffusion Probabilistic Model in Pytorch
PyQt-Fluent-Widgets
A fluent design widgets library based on C++ Qt/PyQt/PySide. Make Qt Great Again.
make-sense
Free to use online tool for labelling photos. https://makesense.ai
make-a-video-pytorch
Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch
phenaki-pytorch
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch
OpenAI-CLIP
Simple implementation of OpenAI CLIP model in PyTorch.
nuwa-pytorch
Implementation of NĂśWA, state of the art attention network for text to video synthesis, in Pytorch
parti-pytorch
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
slot-attention
Implementation of Slot Attention from GoogleAI
memory-efficient-attention-pytorch
Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
segformer-pytorch
Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch
medical-chatgpt
Implementation of ChatGPT, but tailored towards primary care medicine, with the reward being able to collect patient histories in a thorough and efficient manner and come up with a reasonable differential diagnosis
classifier-free-guidance-pytorch
Implementation of Classifier Free Guidance in Pytorch, with emphasis on text conditioning, and flexibility to include multiple text embedding models
electra-pytorch
A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
flash-cosine-sim-attention
Implementation of fused cosine similarity attention in the same style as Flash Attention
res-mlp-pytorch
Implementation of ResMLP, an all MLP solution to image classification, in Pytorch
Soft-Decision-Tree
PyTorch Implementation of "Distilling a Neural Network Into a Soft Decision Tree." Nicholas Frosst, Geoffrey Hinton., 2017.
rvq-vae-gpt
My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation
n-grammer-pytorch
Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
autoregressive-linear-attention-cuda
CUDA implementation of autoregressive linear attention, with all the latest research findings
pytorch-image-captioning
Transformer & CNN Image Captioning model in PyTorch.
nim-tokenizer
Implementation of a simple BPE tokenizer, but in Nim
detectron2onnx-inference
Export [detectron2](https://github.com/facebookresearch/detectron2) model to [onnx](https://github.com/onnx/onnx) and run inference using [caffe2 onnx backend](https://pytorch.org/tutorials/advanced/super_resolution_with_caffe2.html). This let's you run inference on a raspberry pi with acceptable inference times.