hhou435

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

GPT2-Chinese

Chinese version of GPT2 training code, using BERT tokenizer.

hanzi

nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

TencentPretrain

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

UER-py

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

model_card

transformers

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.