Giters

google-research / electra

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Is `google/electra-small-generator` small or small++ ?

richarddwang opened this issue · comments

commented

Hi, I notice that the Electra small and Electra base in GLUE benchmark are Electra-small++ and Electra-base++ in table 8.

To correctly compare my reproduced results,
I am wondering whether google/electra-small-discriminator and google/electra-base-discriminator on Huggingface models hub are also Electra-small++ and Electra-base++ ?

commented

They are also the ++ models.