cloneofsimo / paint-with-words-sd

Implementation of Paint-with-words with Stable Diffusion : method from eDiff-I that let you generate image from text-labeled segmentation map.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Extensions for Automatic1111 version?

mykeehu opened this issue · comments

It's a great utility! I would be very happy if you could make this as an extension for the Automatic1111 version too!
Thank you very much in advance!

This would be a fantastic idea, but I think using Gradio's interface for many-color painting would be very unpleasing...

The first step would be to upload a pre-painted image. I don't know how the painting works in Gradio, but an extra blur slider would adjust the colour/finish transitions. I would use this partly as an alternative to Pix2Pix. There are already color tagged images there that I could convert to SD.

Sure thing. right now Im not so familiar with Gradio, but Ill look forward to add these in A1111 extension

For anyone elses information, there is canonical request on a1111's repo as well.

AUTOMATIC1111/stable-diffusion-webui#4406
, which is very constructive and relevant.

This might help you masking with color.
AUTOMATIC1111/stable-diffusion-webui#3865
@cloneofsimo

This would be a fantastic idea, but I think using Gradio's interface for many-color painting would be very unpleasing...

There's also the krita extension which can be helpful with that.

Here's the corresponding issue to this on the automatic1111 repo: