Phil Wang (lucidrains)

lucidrains

Geek Repo

Location:San Francisco

Home Page:lucidrains.github.io

Github PK Tool:Github PK Tool

ezoic increase your site revenue

Phil Wang's repositories

vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Language:PythonLicense:MITStargazers:10117Issues:121Issues:182

DALLE2-pytorch

Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch

Language:PythonLicense:MITStargazers:4921Issues:79Issues:65

DALLE-pytorch

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

Language:PythonLicense:MITStargazers:4336Issues:90Issues:251

x-transformers

A simple but complete full-attention transformer with a set of promising experimental features from various papers

Language:PythonLicense:MITStargazers:1600Issues:39Issues:63

lightweight-gan

Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image generations that can be trained within a day or two

Language:PythonLicense:MITStargazers:1263Issues:30Issues:102

denoising-diffusion-pytorch

Implementation of Denoising Diffusion Probabilistic Model in Pytorch

Language:PythonLicense:MITStargazers:652Issues:12Issues:27

flamingo-pytorch

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

Language:PythonLicense:MITStargazers:380Issues:0Issues:0

nuwa-pytorch

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

Language:PythonLicense:MITStargazers:358Issues:20Issues:7

x-clip

A concise but complete implementation of CLIP with various experimental improvements from recent papers

Language:PythonLicense:MITStargazers:345Issues:21Issues:3

RETRO-pytorch

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

Language:PythonLicense:Apache-2.0Stargazers:338Issues:17Issues:13

PaLM-pytorch

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

Language:PythonLicense:MITStargazers:315Issues:4Issues:3

memorizing-transformers-pytorch

Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

Language:PythonLicense:MITStargazers:251Issues:5Issues:1

video-diffusion-pytorch

Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch

Language:PythonLicense:MITStargazers:193Issues:16Issues:5

CoCa-pytorch

Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch

Language:PythonLicense:MITStargazers:180Issues:0Issues:0

DALLE2-video

Direct application of DALLE-2 to video synthesis, using factored space-time Unet and Transformers

Language:PythonLicense:MITStargazers:109Issues:0Issues:0

PaLM-jax

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)

Language:PythonLicense:MITStargazers:86Issues:2Issues:0

uniformer-pytorch

Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR 2022

Language:PythonLicense:MITStargazers:78Issues:5Issues:3

deformable-attention

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention"

Language:PythonLicense:MITStargazers:77Issues:0Issues:0

attention

This repository will house a visualization that will attempt to convey instant enlightenment of how Attention works to someone not working in artificial intelligence, with 3Blue1Brown as inspiration

Language:HTMLLicense:MITStargazers:76Issues:19Issues:0

ddpm-proteins

A denoising diffusion probabilistic model (DDPM) tailored for conditional generation of protein distograms

Language:PythonLicense:MITStargazers:68Issues:3Issues:0

RQ-Transformer

Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"

Language:PythonLicense:MITStargazers:58Issues:2Issues:0

differentiable-SDF-pytorch

Implementation of Differentiable Sign-Distance Function Rendering - in Pytorch

License:MITStargazers:47Issues:0Issues:0

anymal-belief-state-encoder-decoder-pytorch

Implementation of the Belief State Encoder / Decoder in the new breakthrough robotics paper from ETH Zürich

Language:PythonLicense:MITStargazers:35Issues:5Issues:2

compositional-attention-pytorch

Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process with disentangled search and retrieval head aggregation, in Pytorch

Language:PythonLicense:MITStargazers:34Issues:0Issues:0

retrieval-augmented-ddpm

Implementation of Retrieval-Augmented Denoising Diffusion Probabilistic Models in Pytorch

Language:PythonLicense:MITStargazers:25Issues:0Issues:0

x-unet

Implementation of a U-net complete with efficient attention as well as the latest research findings

Language:PythonLicense:MITStargazers:24Issues:8Issues:1

gvp-transformer

Implementation of the GVP-Transformer, which was used in the paper "Learning inverse folding from millions of predicted structures" for de novo protein design alongside Alphafold2

Language:PythonLicense:MITStargazers:19Issues:1Issues:0

enformer-jax

Implementation of Enformer, attention network for predicting gene expression, in Jax

Language:PythonLicense:MITStargazers:8Issues:0Issues:0

ResizeRight

The correct way to resize images or tensors. For Numpy or Pytorch (differentiable).

Language:PythonLicense:MITStargazers:7Issues:0Issues:0