what to put in "padding token"??? hints?? please?

Question

what to put in "padding token"??? hints?? please?

bryanray opened this issue a year ago · comments

Bryan Ray commented a year ago

Bryan Ray · Answer 1 · Thu Mar 16 2023 22:54:51 GMT+0800 (China Standard Time)

what is ID and Single token, these words means nothing to me sorry......

hnmr293 · Answer 2 · Thu Mar 16 2023 23:51:48 GMT+0800 (China Standard Time)

Short answer:
If you are not familiar with CLIP, do not touch there.

Lengthy answer:
Input a token or its ID what you want to use as the padding token.
It is used for replacing each target token.

For instance, if you put , (comma) to padding token and put red to target tokens, the word red in your prompt is replaced to ,.

I wrote implementation details here: #5.

If it is blank, the default value _ (underbar) is used.

Bryan Ray · Answer 3 · Fri Mar 17 2023 22:03:03 GMT+0800 (China Standard Time)

#5

thanks!!! this clarify everything!!! good job but please put it on the readme.md ::))) so noob like me can read,, but sucks at finding them other than frontpage LOL

hnmr293 · Answer 4 · Mon Mar 20 2023 00:17:22 GMT+0800 (China Standard Time)

I have updated Readme. Thank you!