Why not try a new model? Like ELECTRA ...
Yang-HangWA opened this issue · comments
I think there are some new model developments that can be added to this work. 😄
This repository implements the models reported in the GECToR paper.
If you want to train models with other transformer pretraining you need to change the code here and here.
@skurzhanskyi Thanks for your reply. I mean there may be other models that do better. Anyway, thank you. I will try this later.