ucinlp / autoprompt

AutoPrompt: Automatic Prompt Construction for Masked Language Models.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

What is the T in your label search algorithm?

MM-IR opened this issue · comments

I am just very curious about your T tokens here - trigger placeholders (a new added special token in the tokenizer with random initialization?)! In other words, can you give me some explanations to your label set searching algorithm? Thanks in advance for your kind help!

The trigger tokens (i.e. [T]) are initialized to [MASK] tokens, not random tokens, that are added to the tokenizer as special tokens. In terms of your question, are you asking how the trigger tokens are connected to the automatic label token selection process for NLP tasks like sentiment analysis?

Yes, it sounds like in your label token selection process, you just simply add these trigger tokens as other tokens, in tandem with the target MASK token, right? Interesting, thanks a lot for your patient explanations!