Giters

dome272 / Diffusion-Models-pytorch

Pytorch implementation of Diffusion Models (https://arxiv.org/pdf/2006.11239.pdf)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

img2img

liuzysy opened this issue · comments

commented

Does anyone have some experience on img2img by using diffusion model?

commented

If you want to use CLIP. You probably don't need to change much. Just making the model a bit bigger and then instead of conditioning on learned class embeddings as I do in the code, you just provide in the CLIP embedding. CLIP embeddings are also just a vector, so same as class embeddings. Does that help?