Question regarding beam search
aditya5558 opened this issue · comments
Hey Yash,
I noticed that you have turned off beam search in your code. Can you share what is the problem with the beam search code in the repo?
Thanks
Hey @aditya5558,
Sorry for the delay in responding.
The released codebase moved quite a bit from the original which was used to run experiments for the paper, and I was unable to reproduce the beam-search numbers that were reported.
If you want to debug/fix this issue, I'd be happy to help/review it. To run the code w/ beam search you just have replace evaluator.evaluate_no_beam function on this line with evaluator.evaluate.
Cheers.
Closing due to inactivity, feel free to reopen.