Any idea on using GPT-2 as the language model for key-gen?

Question

Any idea on using GPT-2 as the language model for key-gen?

yuchenlin opened this issue 5 years ago · comments

Hi Ning,

Thanks for your great work and we are wondering if you have any ideas that we can use GPT-2 for keywords-based sentence generation? If that is possible, it can be helpful for us to include your work as the main benchmark in our ongoing paper. Thank you very much.

NingMiao · Answer 1 · Tue Oct 15 2019 11:18:29 GMT+0800 (China Standard Time)

We actually trained a backward GPT-2 model. It is not difficult since the code for training is released.
I also recommend using BERT or just a forward GPT-2 as the proposal.

(Bill) Yuchen Lin · Answer 2 · Tue Oct 15 2019 11:21:45 GMT+0800 (China Standard Time)

Thanks for the prompt reply. I saw that you mentioned that you have already the code for using CGMH over GPT-2 in another issue. Would you please share the code with us as well? That would be a huge help for our CGMH-based experiments. Thank you very much in advance!