AUTOMATIC1111 / stable-diffusion-webui-tokenizer

An extension for stable-diffusion-webui that adds a tab that lets you preview how CLIP model would tokenize your text.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Thanks!

0xdevalias opened this issue · comments

Haha, thanks for this!

I was literally doing some initial exploration work last night with the idea of making exactly this sort of thing!

Even better that I don't have to do it myself now! 🖤

I know this is a noob question but could you please explain in short why looking at the tokens can be so helpful?