stas00 / porting

Helper scripts and notes that were used while porting various nlp models

Porting

This repo contains helper scripts that were used while porting various nlp models

1. transformers/fairseq-wmt19 - fairseq wmt transformers
2. transformers/deepspeed - deepspeed helper files
3. transformers/translation - translation with transformers
4. datasets/pegasus - pegasus datasets
5. pytorch - pytorch solutions