princeton-nlp / LM-BFF

[ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Templates & Label Word Generation with Multilingual T5

ryangawei opened this issue · comments

Hi,

I want to apply your model to Chinese down-stream task. I wonder if I could replace t5-3b with google-research/multilingual-t5? Like this

python tools/generate_template.py \
    --output_dir my_auto_template \
    --task_name A_CHINESE_TASK \
    --seed 13 21 42 87 100 \
    --t5_model google/mt5-large \
    --beam 100

Thank you very much.

Hi,

Yes you may directly change the model the the multilingual-t5. Note that you need to properly set the initial manual labels in the code.

@gaotianyu1350 Thank you, that's very helpful!