Yuan-ManX / ComfyUI-Tools-Roadmap

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, Animation, Video, Audio, 3D Model, and more!🔥

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

ComfyUI Tools Roadmap 🎮

ComfyUI

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, 3D Model, Animation, Video, Avatar, Audio, Music and more!🔥

Table of Contents

Project List

ComfyUI

ComfyUI Description Source Paper
Comflowyspace Comflowyspace is an open-source AI image and video generation tool committed to providing a better, interactive experience than the standard SDWebUI and ComfyUI. Comflowyspace
ComfyUI The most powerful and modular stable diffusion GUI and backend. ComfyUI
ComfyUI Browser An image/video/workflow browser and manager for ComfyUI. ComfyUI Browser
Comfy.ICU ComfyICU - Run ComfyUI workflows in the Cloud. Comfy.ICU
ComfyUI-Custom-Scripts Enhancements & experiments for ComfyUI, mostly focusing on UI features. ComfyUI-Custom-Scripts
ComfyUI Manager ComfyUI-Manager is an extension designed to enhance the usability of ComfyUI. ComfyUI Manager
ComfyUI_TensorRT This node enables the best performance on NVIDIA RTX™ Graphics Cards (GPUs) for Stable Diffusion by leveraging NVIDIA TensorRT. ComfyUI_TensorRT

^ Back to Contents ^

Image

ComfyUI Description Source Paper
ComfyUI-AnyText AnyText: Multilingual Visual Text Generation And Editing. AnyText arXiv
ComfyUI-AuraSR AuraSR: GAN-based Super-Resolution for real-world. AnyText
comfyui_controlnet_aux ComfyUI's ControlNet Auxiliary Preprocessors.
ComfyUI_ExtraModels Support for miscellaneous image models. Currently supports: DiT, PixArt, T5 and a few custom VAEs. Hunyuan-DiT arXiv
ComfyUI-Flowty-LDSR This is a custom node that lets you take advantage of Latent Diffusion Super Resolution (LDSR) models inside ComfyUI.
ComfyUI-IC-Light ComfyUI native implementation of IC-Light. IC-Light
ComfyUI-InstanceDiffusion Instance-level Control for Image Generation. InstanceDiffusion arXiv
ComfyUI InstantID Zero-shot Identity-Preserving Generation in Seconds. InstantID arXiv
ComfyUI IPAdapter plus The IPAdapter are very powerful models for image-to-image conditioning. IP-Adapter arXiv
ComfyUI-layerdiffuse Transparent Image Layer Diffusion using Latent Transparency. LayerDiffuse
ComfyUI-Marigold Marigold depth estimation in ComfyUI. Marigold arXiv
ComfyUI-MimicBrush Zero-shot Image Editing with Reference Imitation. MimicBrush arXiv
ComfyUI_omost Omost is a project to convert LLM's coding capability to image generation (or more accurately, image composing) capability. Omost
ComfyUI OOTDiffusion Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on. OOTDiffusion arXiv
ComfyUI PhotoMaker Plus Customizing Realistic Human Photos via Stacked ID Embedding. PhotoMaker arXiv
ComfyUI Segment Anything Based on GroundingDino and SAM, use semantic strings to segment any element in an image. Segment Anything Model (SAM) arXiv
ComfyUI StableZero123 A Single Image to Consistent Multi-view Diffusion Base Model. Zero123++ arXiv
ComfyUI_UltimateSDUpscale ComfyUI nodes for the Ultimate Stable Diffusion Upscale script by Coyote-A. Ultimate SD Upscale
PuLID ComfyUI Pure and Lightning ID Customization via Contrastive Alignment. PuLID arXiv

^ Back to Contents ^

Mesh

ComfyUI Description Source Paper
ComfyUI InstantMesh Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models. InstantMesh arXiv

^ Back to Contents ^

Texture

ComfyUI Description Source Paper
Comfy Textures Unreal Engine ⚔️ ComfyUI - Automatic texturing using generative diffusion models.

^ Back to Contents ^

3D Model

ComfyUI Description Source Paper
ComfyUI-Flowty-TripoSR TripoSR custom node for comfyui. TripoSR arXiv
ComfyUI-Tripo This extension integrates Tripo into ComfyUI, allowing users to generate 3D models from text prompts or images directly within the ComfyUI interface. TripoSR arXiv

^ Back to Contents ^

Animation

ComfyUI Description Source Paper
ComfyUI-ADMotionDirector ComfyUI nodes for training AnimateDiff motion loras. AnimateDiff MotionDirector
ComfyUI-AnimateDiff-Evolved Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning. AnimateDiff arXiv
ComfyUI-AnimateDiff-Evolved AnimateDiff-Lightning is a lightning-fast text-to-video generation model. AnimateDiff-Lightning arXiv
Comfyui-AnimateLCM Accelerating the Animation of Personalized Diffusion Models and Adapters with Decoupled Consistency Learning. AnimateLCM arXiv
ComfyUI-DynamiCrafter Animating Open-domain Images with Video Diffusion Priors. DynamiCrafter arXiv
ComfyUI-MagicAnimate Easily use Magic Animate within ComfyUI!
ComfyUI-ToonCrafter Generative Cartoon Interpolation. ToonCrafter

^ Back to Contents ^

Video

ComfyUI Description Source Paper
ComfyUI-DiffSynth-Studio Diffutoon: High-Resolution Editable Toon Shading via Diffusion Models. Diffutoon arXiv
ComfyUI-DragNUWA DragNUWA enables users to manipulate backgrounds or objects within images directly, and the model seamlessly translates these actions into camera movements or object motions, generating the corresponding video. DragNUWA
ComfyUI-SVD Experimental use of stable-video-diffusion in ComfyUI.
ComfyUI-VideoHelperSuite Nodes related to video workflows.

^ Back to Contents ^

Avatar

ComfyUI Description Source Paper
avatar-graph-comfyui A custom nodes module for creating real-time interactive avatars powered by blender bpy mesh api + Avatech Shape Flow runtime.
ComfyUI-AniPortrait Audio-Driven Synthesis of Photorealistic Portrait Animations. AniPortrait arXiv
ComfyUI-Hallo Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation. Hallo arXiv
ComfyUI-IP_LAP The comfyui custom node of IP_LAP to make audio driven videos! IP_LAP arXiv
ComfyUI-LivePortraitKJ LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control! LivePortrait arXiv
Comfyui-MusePose MusePose: a Pose-Driven Image-to-Video Framework for Virtual Human Generation. MusePose
ComfyUI-MuseTalk Real-Time High Quality Lip Synchorization with Latent Space Inpainting! MuseTalk
ComfyUI-MuseV Infinite-length and High Fidelity Virtual Human Video Generation with Visual Conditioned Parallel Denoising! MuseV
ComfyUI-V-Express Conditional Dropout for Progressive Training of Portrait Video Generation. V-Express arXiv
ComfyUI_wav2lip A custom node for ComfyUI that allows you to perform lip-syncing on videos using the Wav2Lip model. It takes an input video and an audio file and generates a lip-synced output video. Wav2Lip arXiv

^ Back to Contents ^

Audio

ComfyUI Description Source Paper
ComfyUI-AudioScheduler AudioScheduler project contains a collection of audio processing nodes.
ComfyUI-ChatTTS ChatTTS is a generative speech model for daily dialogue. ChatTTS
ComfyUI-GPT_SoVITS A Powerful Few-shot Voice Conversion and Text-to-Speech WebUI. GPT-SoVITS
ComfyUI_ParlerTTS Parler-TTS is a lightweight text-to-speech (TTS) model that can generate high-quality, natural sounding speech in the style of a given speaker (gender, pitch, speaking style, etc). Parler-TTS
ComfyUI-StableAudioSampler The New Stable Diffusion Audio Sampler 1.0 In a ComfyUI Node. Make some beats!
ComfyUI-UVR5 The comfyui custom node for UVR5 to separate vocals and background music. UVR5
ComfyUI-XTTS a custom comfyui node for coqui-ai/TTS's xtts module! support 17 languages voice cloning and tts. XTTS

^ Back to Contents ^

Music

ComfyUI Description Source Paper
ComfyUI-SunoAI ComfyUI Node wrapper of SunoAI API.

^ Back to Contents ^

ComfyUI Workflow

ComfyUI Description Source Paper

^ Back to Contents ^

About

Here we will track the latest development tools for ComfyUI, including Image, Mesh, Texture, Animation, Video, Audio, 3D Model, and more!🔥

License:MIT License