Picking the best checkpoint in the pre-exploration setting.
zwx8981 opened this issue · comments
Hi, how did you select the checkpoint for test in the pre-explpration setting ? Did you still pick the checkpoint according to the performances on the validation-unseen set?
Yea, according to the single-run validation-unseen result only.
But I think that it is allowed to use the validation-unseen to pick the best checkpoint as long as the results on test environments are shown.
@airsplay Thanks for the reply.