airsplay / R2R-EnvDrop

PyTorch Code of NAACL 2019 paper "Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Picking the best checkpoint in the pre-exploration setting.

zwx8981 opened this issue · comments

Hi, how did you select the checkpoint for test in the pre-explpration setting ? Did you still pick the checkpoint according to the performances on the validation-unseen set?

Yea, according to the single-run validation-unseen result only.

But I think that it is allowed to use the validation-unseen to pick the best checkpoint as long as the results on test environments are shown.

@airsplay Thanks for the reply.