Do you have a plan to implement BERT in your model?

Question

Do you have a plan to implement BERT in your model?

pdc-kaminaga opened this issue 5 years ago · comments

Thank you for providing great software.
Do you have a plan to implement BERT in your model ?
Is there a way to use BART with magpie now?

Jan Stypka · Answer 1 · Sat Oct 26 2019 11:04:52 GMT+0800 (China Standard Time)

As we're not doing much active development on this project now, it's quite unlikely that we're going to add BERT support in the near future. The model though supports providing any dictionary-based language model, so you can substitute word2vec with anything that can work as a look up table as word vectors.

…

On 24 Oct 2019, at 23:02, pdc-kaminaga ***@***.***> wrote: Thank you for providing great software. Do you have a plan to implement BERT in your model ? Is there a way to use BART with magpie now? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.

pdc-kaminaga · Answer 2 · Sun Oct 27 2019 20:18:18 GMT+0800 (China Standard Time)

I thank you for your advice.
I’ll try my best.