Giters

microsoft / fastformers

FastFormers - highly efficient transformer models for NLU

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Support for XLnet

LifeIsStrange opened this issue · comments

commented

XLnet is supported by Transformers and in 2020 still remains the pre trained language model with the most SOTA on paperswithcode.com (far beyond BERT, Albert & ci)

commented

Thanks for the opinion. We will look at if we can support this in the future.

commented

The main purpose of this repository is to demonstrate the models from the FastFormers paper.
At the moment, we are not planning to expand the scope.
Thank you.