Rohan Varma's repositories
neural-machine-translation
Implementing seq 2 seq and soft attention models
rohan-blog
Software Engineer @ Facebook
AlphaPose
Real-Time and Accurate Multi-Person Pose Estimation&Tracking System
dlrm
An implementation of a deep learning recommendation model (DLRM)
elastic
PyTorch elastic training
examples
A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
fairscale
PyTorch extensions for high performance and large scale training.
gloo
Collective communications library with various primitives for multi-machine training.
metaseq
Repo for external large-scale work
mixprecision
modular repo to work on bert attn issue with mixed precision
multimodal
TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
pytorch-ddp-models
Some pytorch DDP models
pytorch-lightning
The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.
reid-strong-baseline
Bag of Tricks and A Strong Baseline for Deep Person Re-identification
sagemaker-python-sdk
A library for training and deploying machine learning models on Amazon SageMaker
t5_11
housing our model example of fine tuning an 11B t5 with FSDP
tnt
A lightweight library for PyTorch training tools and utilities
torchdistx
Torch Distributed Experimental
torchrec
Pytorch domain library for recommendation systems
torchrec-1
Pytorch domain library for recommendation systems
transformer_framework
framework for plug and play of various transformers (vision and nlp) with FSDP
tutorials
PyTorch tutorials.