Rahul2991

vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

DALLE2-pytorch

Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

The-Complete-FAANG-Preparation

This repository contains all the DSA (Data-Structures, Algorithms, 450 DSA by Love Babbar Bhaiya, FAANG Questions), Technical Subjects (OS + DBMS + SQL + CN + OOPs) Theory+Questions, FAANG Interview questions, and Miscellaneous Stuff (Programming MCQs, Puzzles, Aptitude, Reasoning). The Programming languages used for demonstration are C++, Python, and Java.

wait-for-it

Pure bash script to test and wait on the availability of a TCP host and port

denoising-diffusion-pytorch

Implementation of Denoising Diffusion Probabilistic Model in Pytorch

PyQt-Fluent-Widgets

A fluent design widgets library based on C++ Qt/PyQt/PySide. Make Qt Great Again.

make-sense

Free to use online tool for labelling photos. https://makesense.ai

make-a-video-pytorch

Implementation of Make-A-Video, new SOTA text to video generator from Meta AI, in Pytorch

phenaki-pytorch

Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch

OpenAI-CLIP

Simple implementation of OpenAI CLIP model in PyTorch.

nuwa-pytorch

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

parti-pytorch

Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch

slot-attention

Implementation of Slot Attention from GoogleAI

memory-efficient-attention-pytorch

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

segformer-pytorch

Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch

medical-chatgpt

Implementation of ChatGPT, but tailored towards primary care medicine, with the reward being able to collect patient histories in a thorough and efficient manner and come up with a reasonable differential diagnosis

classifier-free-guidance-pytorch

Implementation of Classifier Free Guidance in Pytorch, with emphasis on text conditioning, and flexibility to include multiple text embedding models

x-unet

Implementation of a U-net complete with efficient attention as well as the latest research findings

electra-pytorch

A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch

flash-cosine-sim-attention

Implementation of fused cosine similarity attention in the same style as Flash Attention

res-mlp-pytorch

Implementation of ResMLP, an all MLP solution to image classification, in Pytorch

Finding-an-Outlier

Soft-Decision-Tree

PyTorch Implementation of "Distilling a Neural Network Into a Soft Decision Tree." Nicholas Frosst, Geoffrey Hinton., 2017.

rvq-vae-gpt

My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation

n-grammer-pytorch

Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch

autoregressive-linear-attention-cuda

CUDA implementation of autoregressive linear attention, with all the latest research findings

pytorch-image-captioning

Transformer & CNN Image Captioning model in PyTorch.

nim-tokenizer

Implementation of a simple BPE tokenizer, but in Nim

detectron2onnx-inference

Export [detectron2](https://github.com/facebookresearch/detectron2) model to [onnx](https://github.com/onnx/onnx) and run inference using [caffe2 onnx backend](https://pytorch.org/tutorials/advanced/super_resolution_with_caffe2.html). This let's you run inference on a raspberry pi with acceptable inference times.

open_clip

An open source implementation of CLIP.