thunlp / OpenPrompt

An Open-Source Framework for Prompt-Learning.

Home Page:https://thunlp.github.io/OpenPrompt/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How to use Chinese model?

drxmy opened this issue · comments

commented

Many Chinese models in hugging face like T5 use different tokenizer and model. For example, Chinese T5 uses T5ForConditionalGeneration and BertTokenizer. Is there some way to handle this kind of problems? Thank you!

We write a tutorial to show the use case that does not fit into the default configuration of OpenPrompt. In this tutorial, we use a bert tokenizer and a T5 model to do a Chinese Classic Poetry Retrieval task. Thanks for posing this issue!

commented

Thanks a lot!