Clearailhc / Openprompt-learner

A Chinese tuturial

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

list index out of range

652994331 opened this issue · comments

Hi, i am new to prompt learning and glad to find your demo projects. I was trying to use the 0_base.py under tutorial and here came a problem.
[[{'text': 'It was a complex language. Not written down but handed down. One might say it was peeled down.', 'loss_ids': 0, 'shortenable_ids': 1}, {'text': ' Question:', 'loss_ids': 0, 'shortenable_ids': 0}, {'text': ' the language was peeled down', 'loss_ids': 0, 'shortenable_ids': 1}, {'text': '? Is it correct?', 'loss_ids': 0, 'shortenable_ids': 0}, {'text': '', 'loss_ids': 1, 'shortenable_ids': 0}, {'text': '.', 'loss_ids': 0, 'shortenable_ids': 0}], {'guid': 0, 'label': 0}]
Traceback (most recent call last):
File "0_basic.py", line 69, in
tokenized_example = wrapped_t5tokenizer.tokenize_one_example(wrapped_example, teacher_forcing=False)
File "/opt/cephfs1/asr/users/qizhou.huang/qizhou/OpenPrompt/openprompt/plms/seq2seq.py", line 74, in tokenize_one_example
decoder_input_ids.append(self.mask_token_ids(num_mask_token_used))
File "/opt/cephfs1/asr/users/qizhou.huang/qizhou/OpenPrompt/openprompt/plms/seq2seq.py", line 37, in mask_token_ids
return self.tokenizer.additional_special_tokens_ids[i]
IndexError: list index out of range

i also tried to download super glue from huggingface by "raw_dataset = load_dataset('super_glue', 'cb')" but still not working here.
could you please help me out, thank you.