CoffeeVampir3 / ComfyUI-Kolors-MZ

Kolors的ComfyUI原生采样器实现(Kolors ComfyUI Native Sampler Implementation)

Recent changes

• [2024-07-18] IPA相关节点已在ComfyUI_IPAdapter_plus中支持
• [2024-07-17] 新增支持IPAdapter_plus的加载器和高级应用节点 MZ_KolorsCLIPVisionLoader,MZ_IPAdapterModelLoaderKolors,MZ_IPAdapterAdvancedKolors
• [2024-07-14] 删除自动兼容ControlNet, 新增MZ_KolorsControlNetPatch节点

ComfyUI上Kolors的实现

参考自 https://github.com/kijai/ComfyUI-KwaiKolorsWrapper

使用ComfyUI原生采样

工作流在examples/workflow.png中获取

unet模型放置在 models/unet/ 文件夹下 下载地址: https://huggingface.co/Kwai-Kolors/Kolors/blob/main/unet/diffusion_pytorch_model.fp16.safetensors

chatglm3放置在 models/LLM/ 文件夹下 下载地址: https://huggingface.co/Kijai/ChatGLM3-safetensors/blob/main/chatglm3-fp16.safetensors

官方IP-Adapter-Plus模型下载地址

https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/blob/main/ip_adapter_plus_genernal.bin 下载至 models/ipadapter/

https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/blob/main/image_encoder/pytorch_model.bin 下载至 models/clip_vision/

Implementation of Kolors on ComfyUI

Reference from https://github.com/kijai/ComfyUI-KwaiKolorsWrapper

Using ComfyUI Native Sampling

The workflow is obtained in examples/workflow.png

The unet model is placed in the models/unet/ folder Download link: https://huggingface.co/Kwai-Kolors/Kolors/blob/main/unet/diffusion_pytorch_model.fp16.safetensors

The chatglm3 is placed in the models/LLM/ folder Download link: https://huggingface.co/Kijai/ChatGLM3-safetensors/tree/main

Official IP-Adapter-Plus model download link

https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/ip_adapter_plus_genernal.bin Download to models/ipadapter/

https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/blob/main/image_encoder/pytorch_model.bin Download to models/clip_vision/

FAQ

name 'round_up' is not defined

• 参考:THUDM/ChatGLM2-6B#272 (comment) , 使用 pip install cpm_kernels 或者 pip install -U cpm_kernels 更新 cpm_kernels

module 'comfy.model_detection' has no attribute 'unet_prefix_from_state_dict'

• 更新ComfyUI本体到最新版本

RuntimeError: Only Tensors of floating point dtype can require gradients

• 尝试使用fp16版本的模型: https://huggingface.co/Kijai/ChatGLM3-safetensors/blob/main/chatglm3-fp16.safetensors

Error occurred when executing MZ_ChatGLM3Loader: 'ChatGLMModel' object has no attribute 'transformer'

• 检查ChatGLM3Loader节点选择的模型是否已经正确下载

Credits

• Kolors
• ComfyUI
• ComfyUI_IPAdapter_plus

Star History

Contact

• 微信Wechat: minrszone
• Bilibili: minus_zone
• 小红书: MinusZoneAI

Sponsorship