mit-han-lab / lite-transformer

[ICLR 2020] Lite Transformer with Long-Short Range Attention

https://arxiv.org/abs/2004.11886

mit-han-lab/lite-transformer Issues

Can‘t find the cnn branch,
Updated a year ago
about the global and local features in fig 3
Updated 2 years ago2
wmt16_en_de dataset link
Updated 2 years ago1
model pruning
Updated 2 years ago
about kernel size
Closed 2 years ago1
About data !
Closed 2 years ago1
about dynamicconv_cuda
Closed 2 years ago1
about padding！！！
Closed 2 years ago2
Model size confuse
Closed 4 years ago1
TransformerEncoderLayer
Updated 3 years ago4
in paragra 4 of
Closed 3 years ago1
in the paragra 4 of paper
Closed 3 years ago1
How to measure the FLOPs/MACs?
Closed 3 years ago2
Error while testing the model
Closed 3 years ago8
Can not get the result as the paper if train the transformer from scratch.
Updated 3 years ago2
Error while evaluating model
Closed 3 years ago9
Missing Data Preparation section for the CNN / DailyMail dataset
Closed 3 years ago1
Please share your quantization, quantization+pruning checkpoints
Updated 3 years ago1
Export model to ONNX
Updated 3 years ago1
Quantization
Closed 3 years ago1
transfomer model with different paramters
Closed 3 years ago3
What functions are achieved in the cu code? The cu code is too hard for me to understand. Thank you.
Closed 3 years ago1
Why do you recode the cpp code and cu code? What function is necessary?
Closed 3 years ago1
Could you please point out the core code, as there are too many fairseq code. Thank you!
Closed 3 years ago2
Will you release the TensorFlow code in the future?
Closed 3 years ago1
CNN\DM dateset preprocess (bpe 30K)
Closed 3 years ago1
wmt14 en-fr data processing problem
Closed 3 years ago3
Is there any link for downloading iwslt14.de-en pretrained model?
Closed 3 years ago1
Is there any guidance on preparing the cnndm dataset?
Closed 3 years ago1
Data preprocessing
Closed 4 years ago1
Model Compression
Closed 4 years ago5
Wrong key_padding_mask position?
Closed 4 years ago3
Could you share Quantify and Pruning script? Thank you very much!
Closed 4 years ago2
DeprecationWarning
Closed 4 years ago1
register_task of abstractive summarization
Closed 4 years ago1
could you share the tensorboard log file? thank you so much!
Updated 4 years ago1
training config for wikitext103
Closed 4 years ago4
Applying factorized embedding
Closed 4 years ago4
Summarization checkpoint release ?
Closed 4 years ago1