How to use Chinese model?
drxmy opened this issue · comments
drxmy commented
Many Chinese models in hugging face like T5 use different tokenizer and model. For example, Chinese T5 uses T5ForConditionalGeneration and BertTokenizer. Is there some way to handle this kind of problems? Thank you!
DingDing commented
We write a tutorial to show the use case that does not fit into the default configuration of OpenPrompt. In this tutorial, we use a bert tokenizer and a T5 model to do a Chinese Classic Poetry Retrieval task. Thanks for posing this issue!
drxmy commented
Thanks a lot!