TransformerZoo
a collection of transformers in pytorch 1.0
✅ Transformer Encoder-Decoder
☑️ Universal TED
☑️ TED relative position encoding (Transformer-XL)
☑️ TED layer attention
☑️ TD
☑️ Bert
a collection of transformers in pytorch1.0
TransformerZoo
a collection of transformers in pytorch 1.0
✅ Transformer Encoder-Decoder
☑️ Universal TED
☑️ TED relative position encoding (Transformer-XL)
☑️ TED layer attention
☑️ TD
☑️ Bert
a collection of transformers in pytorch1.0