Pre-training scripts should allow resuming from checkpoints

Question

szha opened this issue 3 years ago · comments

Description

Currently, the ELECTRA pre-training script can't resume from last checkpoint. It will be useful to enhance the script to resume from checkpoints.

Nandini Bansal · Answer 1 · Thu Mar 11 2021 03:43:09 GMT+0800 (China Standard Time)

Hi, is this issue open for contribution? If yes, I would like to work on it.

Leonard Lausen · Answer 2 · Fri Mar 12 2021 05:11:01 GMT+0800 (China Standard Time)

Hi @nandinib1999, contributions to GluonNLP are always welcome. Let us know if you have any questions.

Nandini Bansal · Answer 3 · Sat Mar 13 2021 02:44:57 GMT+0800 (China Standard Time)

Thanks a lot! I will try to set up the codebase tonight and will come back in case of any doubts.