shadowcz007 / comfyui-mixlab-nodes

Workflow-to-APP、ScreenShare&FloatingVideo、GPT & 3D、SpeechRecognition&TTS

适配了最新版comfyui的py3.11 ，torch 2.1.2+cu121 Mixlab nodes discord

相关插件推荐

comfyui-sd-prompt-mixlab

comfyui-Image-reward

comfyui-ultralytics-yolo

comfyui-moondream

最新：

ChatGPT节点支持 Local LLM（llama.cpp），Phi3、llama3 都可以直接一个节点运行了。

Model download,move to :models/llamafile/

强烈推荐：Phi-3-mini-4k-instruct-GGUF

备选：llama3_if_ai_sdpromptmkr_q2k

🚀🚗🚚🏃 Workflow-to-APP

• 新增AppInfo节点，可以通过简单的配置，把workflow转变为一个Web APP。
• 支持多个web app 切换
• 发布为app的workflow，可以在右键里再次编辑了
• web app可以设置分类，在comfyui右键菜单可以编辑更新web app
• 支持动态提示

• Support multiple web app switching.
• Add the AppInfo node, which allows you to transform the workflow into a web app by simple configuration.
• The workflow, which is now released as an app, can also be edited again by right-clicking.
• The web app can be configured with categories, and the web app can be edited and updated in the right-click menu of ComfyUI.

Example:

• workflow text-to-image

APP-JSON:

• text-to-image
• image-to-image
• text-to-text

暂时支持 9 种节点作为界面上的输入节点：Load Image、VHS_LoadVideo、CLIPTextEncode、PromptSlide、TextInput_、Color、FloatSlider、IntNumber、CheckpointLoaderSimple、LoraLoader

输出节点：PreviewImage 、SaveImage、ShowTextForGPT、VHS_VideoCombine、PromptImage

seed统一输入控件，支持：SamplerCustom、KSampler

配套ps插件

如果遇到上传图片不成功，请检查下：局域网或者是云服务，请使用https，端口8189这个服务（ 感谢 @Damien 反馈问题）

If you encounter difficulties in uploading images, please check the following: for local network or cloud services, please use HTTPS and the service on port 8189. (Thanks to @Damien for reporting the issue.)

🏃🚗🚚🚀 Real-time Design

ScreenShareNode & FloatingVideoNode. Now comfyui supports capturing screen pixel streams from any software and can be used for LCM-Lora integration. Let's get started with implementation and design! 💻🌐

newNode.mp4

ScreenShareNode & FloatingVideoNode

!! Please use the address with HTTPS (https://127.0.0.1).

SpeechRecognition & SpeechSynthesis

Voice + Real-time Face Swap Workflow

GPT

Support for calling multiple GPTs.Local LLM（llama.cpp）、 ChatGPT、ChatGLM3 、ChatGLM4 , Some code provided by rui. If you are using OpenAI's service, fill in https://api.openai.com/v1 . If you are using a local LLM service, fill in http://127.0.0.1:xxxx/v1 . Azure OpenAI:https://xxxx.openai.azure.com

workflow-5

最新：ChatGPT节点支持 Local LLM（llama.cpp），Phi3、llama3 都可以直接一个节点运行了。

Model download,move to :models/llamafile/

强烈推荐：Phi-3-mini-4k-instruct-GGUF

备选：llama3_if_ai_sdpromptmkr_q2k

Prompt

PromptSlide

randomPrompt

ClipInterrogator

add clip-interrogator

PromptImage & PromptSimplification,Assist in simplifying prompt words, comparing images and prompt word nodes.

ChinesePrompt && PromptGenerate，中文prompt节点，直接用中文书写你的prompt

Layers

A new layer class node has been added, allowing you to separate the image into layers. After merging the images, you can input the controlnet for further processing.

3D

workflow

workflow

Image

LoadImagesToBatch

Upload multiple images for batch input into the IP adapter.

LoadImagesFromLocal

Monitor changes to images in a local folder, and trigger real-time execution of workflows, supporting common image formats, especially PSD format, in conjunction with Photoshop.

workflow-4

LoadImagesFromURL

Conveniently load images from a fixed address on the internet to ensure that default images in the workflow can be executed.

Style

Apply VisualStyle Prompting , Modified from ComfyUI_VisualStylePrompting

StyleAligned , Modified from style_aligned_comfy

Utils

The Color node provides a color picker for easy color selection, the Font node offers built-in font selection for use with TextImage to generate text images, and the DynamicDelayByText node allows delayed execution based on the length of the input text.

• 添加了DynamicDelayByText功能，可以根据输入文本的长度进行延迟执行。

• Added DynamicDelayByText, enabling delayed execution based on input text length.

• 使用CkptNames 对比不同的模型效果

• CkptNames compare the effects of different models.

Other Nodes

workflow-1

TransparentImage

FeatheredMask、SmoothMask

Add edges to an image.

LaMaInpainting

from simple-lama-inpainting

rembgNode

"briarmbg","u2net","u2netp","u2net_human_seg","u2net_cloth_seg","silueta","isnet-general-use","isnet-anime"

*** briarmbg *** model was developed by BRlA Al and can be used as an open-source model for non-commercial purposes

Improvement

• Add "help" option to the context menu for each node.
• Add "Nodes Map" option to the global context menu.

An improvement has been made to directly redirect to GitHub to search for missing nodes when loading the graph.

Models

• Download TripoSR and place it in models/triposr

• Download facebook/dino-vitb16 and place it in models/triposr/facebook/dino-vitb16

Download rembg Models,move to:models/rembg

Download lama, move to : models/lama

Download Salesforce/blip-image-captioning-base, move to :models/clip_interrogator/Salesforce/blip-image-captioning-base

Download succinctly/text2image-prompt-generator,move to:models/prompt_generator/text2image-prompt-generator

Download Helsinki-NLP/opus-mt-zh-en,move to:models/prompt_generator/opus-mt-zh-en

Installation

manually install, simply clone the repo into the custom_nodes directory with this command:

cd ComfyUI/custom_nodes

git clone https://github.com/shadowcz007/comfyui-mixlab-nodes.git

Install the requirements:

run directly:

cd ComfyUI/custom_nodes/comfyui-mixlab-nodes
install.bat

or install the requirements using:

../../../python_embeded/python.exe -s -m pip install -r requirements.txt

If you are using a venv, make sure you have it activated before installation and use:

pip3 install -r requirements.txt

Chinese community

访问 www.mixcomfy.com，获得更多内测功能，关注微信公众号：Mixlab无界社区

File / LoadImagesFromPath SaveImageToLocal LoadImagesFromURL

discussions:

discussions