Ross Wightman's starred repositories
pytorch_geometric
Graph Neural Network Library for PyTorch
vit-pytorch
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
deepmind-research
This repository contains implementations and illustrative code to accompany DeepMind publications
DALLE-pytorch
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
lambda-networks
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
awesome-jax
JAX - A curated list of resources https://github.com/google/jax
torchdistill
A coding-free framework built on PyTorch for reproducible deep learning studies. 🏆25 knowledge distillation methods presented at CVPR, ICLR, ECCV, NeurIPS, ICCV, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
tf-gnn-samples
TensorFlow implementations of Graph Neural Networks
TimeSformer-pytorch
Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification
self_supervised
Implementation of popular SOTA self-supervised learning algorithms as Fastai Callbacks.
halonet-pytorch
Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones
glom-pytorch
An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up processing, and attention (consensus between columns), for emergent part-whole heirarchies from data
defgrid-release
Official PyTorch implementation of Deformable Grid (ECCV 2020)
baby-vision
Self-supervised learning through the eyes of a child
imagenet-testbed
ImageNet Testbed, associated with the paper "Measuring Robustness to Natural Distribution Shifts in Image Classification."
global-self-attention-network
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks