laiguokun / Funnel-Transformer

laiguokun/Funnel-Transformer Issues

Funnel Transformer with Roberta Tokenizer.
Updated 2 years ago
Pretrained models link error
Updated 3 years ago1
Train From Scratch
Updated 3 years ago
Question related to pretraining with residual connection
Updated 3 years ago
Deep VAEs as a research direction for the successor of XLnet
Updated 4 years ago
An Issue about the position embedding code
Updated 4 years ago
Several Issue About the Paper
Closed 4 years ago2
Pretraining Issues
Updated 4 years ago7
Issue when trying to create TFrecords
Closed 4 years ago4
Would you like to provide a efficiency pipeline to preprocess large corpus?
Closed 4 years ago4
Do you apply wnli trick ? If so, can you open the code ?
Updated 4 years ago
How long does it take to do pre-training?
Updated 4 years ago1
Creation of pretraining data
Closed 4 years ago2