This extension adds segment anything preprocessor inside Mikubill/sd-webui-controlnet into stable-diffusion-webui.
- Install Mikubill/sd-webui-controlnet extension
- Install continue-revolution/sd-webui-segment-anything extension
- Download sam_hq_vit_l.pth model and put it into
extensions/sd-webui-segment-anything/models/sam
- Install this extension
- Optional download this model (SD1.x), rename it into
controlnet-segment-anything.pth
, then put it intomodels/ControlNet
, or controlnet-union-sdxl-1.0 (SDXL)
You can use this preprocessor with cn models mentioned before and also with regular segmentation controlnet and t2ia models sd-controlnet-seg, t2iadapter_seg_sd14v1, t2i-adapter-sdxl-segmentation. Also works with this GWM_magic_draw_landscape_controlnet model (not only for landspaces)
Options
You can adjust Auto SAM options used in this module in the Segment Anything settings:
You can add them into quick settings or into settings in ui if you want
Extras tab
You can also use this preprocessor inside Extras tab with my other extension sd-webui-cn-in-extras-tab