openvinotoolkit / stable-diffusion-webui

Stable Diffusion web UI

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Bug]: Multipe Controlnet Units

JGrant15 opened this issue · comments

Is there an existing issue for this?

  • I have searched the existing issues and checked the recent builds/commits

What happened?

Using the Control_Net branch, when using multiple controlnet units in img2img I'm receiving different errors depending on the amount of Units/ specific types I use. When using 2 Units I get this error

ValueError: If image batch size is not 1, image batch size must be same as prompt batch size. image batch size: 2, prompt batch size: 1

If I change the batch size to 2 it will run, but if I use a specific control type that requires a different input image (Reference for example) it uses the supplied reference image as the input image for the second batch

When using 3 units this is the error I receive.

ValueError: For multiple controlnets: image must have the same length as the number of controlnets, but got 3 images and 2 ControlNets.

Just to confirm the 3 types I'm testing with are Canny, Depth & Reference Only

Steps to reproduce the problem

  1. Go to Img2Img tab
  2. Activate the OpenVINO script
  3. Enter prompt and supply an image for the input
  4. Enable 2 or 3 controlnet units, Canny, Depth, Reference only
  5. Press Generate

What should have happened?

The resulting image should have used the 2/3 control net units to control the generated image.

Sysinfo

sysinfo-2023-10-16-17-54.txt

What browsers do you use to access the UI ?

No response

Console logs

https://pastebin.com/KV7kAV1N

Additional information

No response

Running in to the same problem, when combining multiple control units (inpaint & MLSD):
RuntimeError: Exception from src\inference\src\core.cpp:116:
[ GENERAL_ERROR ] [CL ext] Can not allocate nullptr for USM type.