GPT vs BERT, under same computation and data resource, which one is better for downstream tasks like GLUE?

[physicist4AI]

Thank you very much.

[李熠阳]

感觉BERT之类的用auto encoder模式来预训练的模型更适合GLUE吧，GPT比较擅长text generation