Wei Li's repositories
ACLPUB
The official tool for creating proceedings for conferences of the Association for Computational Linguistics (ACL).
Awesome-Text-to-Image
A Survey on Text-to-Image Generation/Synthesis.
BertSum
Code for paper Fine-tune BERT for Extractive Summarization
bottom-up-attention
Bottom-up attention model for image captioning and VQA, based on Faster R-CNN and Visual Genome
CLIP
Contrastive Language-Image Pretraining
ControlNet
Let us control diffusion models
DALL-E
PyTorch package for the discrete VAE used for DALL·E.
DALLE2-pytorch
Implementation of DALL-E 2, OpenAI's updated text-to-image synthesis neural network, in Pytorch
fastmoe
A fast MoE impl for PyTorch
gpt-neo
An implementation of model parallel GPT2& GPT3-like models, with the ability to scale up to full GPT3 sizes (and possibly more!), using the mesh-tensorflow library.
Graph-to-seq-comment-generation
Code for the paper ``Coherent Comments Generation for Chinese Articles with a Graph-to-Sequence Model''
Graph2Seq
Graph2Seq is a simple code for building a graph-encoder and sequence-decoder for NLP and other AI/ML/DL tasks.
MatchZoo
Facilitating the design, comparison and sharing of deep text matching models.
nlg-eval
Evaluation code for various unsupervised automated metrics for Natural Language Generation.
Open-Sora
Open-Sora: Democratizing Efficient Video Production for All
open_clip
An open source implementation of CLIP.
OpenNMT-py
Open Source Neural Machine Translation in PyTorch
prismatic-vlms
A flexible and efficient codebase for training visually-conditioned language models (VLMs)
pyGAT
Pytorch implementation of the Graph Attention Network model by Veličković et. al (2017, https://arxiv.org/abs/1710.10903)
pytorch-image-models
PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more
pytorch-pretrained-BERT
📖The Big-&-Extending-Repository-of-Transformers: Pretrained PyTorch models for Google's BERT, OpenAI GPT & GPT-2, Google/CMU Transformer-XL.
Research
novel deep learning research works with PaddlePaddle
sentencepiece
Unsupervised text tokenizer for Neural Network-based text generation.
unilm
UniLM - Unified Language Model Pre-training
VILLA
Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER adversarial training part
weili-nlp.github.io
Personal Page
youtube-dl
Command-line program to download videos from YouTube.com and other video sites