controllable-generation

There are 2 repositories under controllable-generation topic.

yang-song / score_sde_pytorch
PyTorch implementation for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)
pytorch stochastic-differential-equations inverse-problems generative-models score-matching score-based-generative-modeling controllable-generation iclr-2021 diffusion-models
Language:Jupyter Notebook 2000
ttengwang / Caption-Anything
Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with diverse controls for user preferences. https://huggingface.co/spaces/TencentARC/Caption-Anything https://huggingface.co/spaces/VIPLab/Caption-Anything
chatgpt controllable-generation segment-anything controllable-image-captioning image-captioning
Language:Python 1761
yang-song / score_sde
Official code for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)
controllable-generation diffusion-models flax generative-models iclr-2021 inverse-problems jax score-based-generative-modeling score-matching stochastic-differential-equations
Language:Jupyter Notebook 1618
ermongroup / SDEdit
PyTorch implementation for SDEdit: Image Synthesis and Editing with Stochastic Differential Equations
pytorch score-matching image-editing image-generation controllable-generation image-manipulation
Language:Python 1124
PRIV-Creation / Awesome-Controllable-T2I-Diffusion-Models
A collection of resources on controllable generation with text-to-image diffusion models.
awesome awesome-list controllable-generation diffusion-models multi-concept personalization spatial-controls text-to-image
1027
MyNiuuu / MOFA-Video
[ECCV 2024] MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model.
aigc diffusion-models eccv2024 generative-ai generative-models video-diffusion-model controllable-generation image2video
Language:Python 752
open-mmlab / StyleShot
StyleShot: A SnapShot on Any Style. 一款可以迁移任意风格到任意内容的模型，无需针对图片微调，即能生成高质量的个性风格化图片!
controllable-generation style-transfer text-to-image
Language:Python 431
kpandey008 / DiffuseVAE
Official implementation of "DiffuseVAE: Efficient, Controllable and High-Fidelity Generation from Low-Dimensional Latents"
generative-model vae diffusion-models ddpm controllable-generation latent-variable-models
Language:Python 374
haofanwang / awesome-conditional-content-generation
Update-to-data resources for conditional content generation, including human motion generation, image or video generation and editing.
aigc awesome-list conditional-generation controllable-generation cross-modality diffusion-models
276
hancyran / LiDAR-Diffusion
[CVPR 2024] Official implementation of "Towards Realistic Scene Generation with LiDAR Diffusion Models"
controllable-generation diffusion-models lidar lidar-diffusion-models lidar-generation range-image text-to-lidar
Language:Python 229
xyfJASON / ctrlora
[ICLR 2025] Codebase for "CtrLoRA: An Extensible and Efficient Framework for Controllable Image Generation"
controllable-generation controlnet image-to-image lora
Language:Python 224
WU-CVGL / MVControl
[3DV-2025] Official implementation of "Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting"
3d-generation 3d-geometry controllable-generation gaussian-splatting multi-view-networks
Language:Python 202
KangweiiLiu / Awesome_Audio-driven_Talking-Face-Generation
A curated list of resources of audio-driven talking face generation
talking-face-generation audio-driven-talking-face speech-driven-talking-face generative-adversarial-networks paperlist controllable-generation
141
open-mmlab / AnyControl
[ECCV 2024] AnyControl, a multi-control image synthesis model that supports any combination of user provided control signals. 一个支持用户自由输入控制信号的图像生成模型，能够根据多种控制生成自然和谐的结果！
controllable-generation multi-control text-to-image
Language:Python 128
samxuxiang / hnc-cad
[ICML 2023] Official PyTorch Implementation of "Hierarchical Neural Coding for Controllable CAD Model Generation".
computer-aided-design generative-model hierarchy transformer vq-vae 3d autocomplete controllable-generation pytorch shape-completion masking
Language:Python 105
GGGHSL / InfoSwap-master
Official PyTorch Implementation for InfoSwap
cvpr2021 controllable-generation photorealistic face-swap 1024
Language:Python 104
ImKeTT / CTG-latentAEs
[Paperlist] Awesome paper list of controllable text generation via latent auto-encoders. Contributions of any kind are welcome.
natural-language-processing paperlist latent-variable-models autoencoders controllable-generation generative-model representation-learning text-generation vae variational-autoencoder
51
ChocoWu / Any2Caption
This is the project for 'Any2Caption', Interpreting Any Condition to Caption for Controllable Video Generation
controllable-generation diffusion dit mllm multimodal-large-language-models video-captioning video-diffusion video-editing video-generation video-dit
44
jxzhangjhu / awesome-LLM-controlled-decoding-generation
awesome-LLM-controlled-constrained-generation
constrained-generation controllable-generation controllable-text-generation decoding-algorithm instruction-tuning large-language-models llms neuro-symbolic non-autoregressive inference-time
43
LabShuHangGU / PerLDiff
PerLDiff: Controllable Street View Synthesis Using Perspective-Layout Diffusion Models
3d-annotation autonomous-driving controllable-generation diffusion-models geometric-priors
Language:Jupyter Notebook 43
ImKeTT / AdaVAE
[Preprint] AdaVAE: Exploring Adaptive GPT-2s in VAEs for Language Modeling PyTorch Implementation
controllable-generation gpt-2 nlp parameter-efficient-tuning representation-learning text-classification text-generation vae variational-autoencoder
Language:Python 35
VSAnimator / collage-diffusion
Implementation of Collage Diffusion (https://arxiv.org/abs/2303.00262)
art controllable-generation diffusion diffusion-models generative-art generative-model photoshop
Language:Jupyter Notebook 35
ImKeTT / PCAE
[KBS] PCAE: A Framework of Plug-in Conditional Auto-Encoder for Controllable Text Generation PyTorch Implementation
bart controllable-generation deep-learning nlp plug-and-play-language-models text-generation variational-autoencoder
Language:Python 25
BioMedIA-MBZUAI / XReal
controllable-generation diffusion-models image-generation image-synthesis x-ray-images
Language:Python 21
bladewaltz1 / ModeCap
Controllable mage captioning model with unsupervised modes
image-captioning neurips-2022 controllable-generation
Language:Python 21
wangqiang9 / Awesome-Controllable-Video-Diffusion
Awesome Controllable Video Generation with Diffusion Models
awesome controllable-generation diffusion diffusion-model diffusion-models video-generation
21
ha-lins / DTG-SI
Code for "Data-to-text Generation with Style Imitation." [Findings of EMNLP 2020]
controllable-generation emnlp2020 text-generation text-style-transfer
Language:Lua 14
Robin-WZQ / CCLAP
[ICME'23, oral] CCLAP: Controllable Chinese Landscape Painting Generation
art-generation chinese-landscape-painting controllable-generation stable-diffusion
Language:Python 14
Justin900429 / autonomous_driving_with_diffusion_model
Using diffusion model to reach controllable end-to-end driving with Carla simulation environment.
autonomous-driving carla-simulator controllable-generation deep-learning diffusion-model end-to-end-driving pytorch
Language:Python 11
kenchan0226 / control-sum-cmdp
Source code of our TACL paper "Controllable Summarization with Constrained Markov Decision Process"
controllable-generation pytorch summarization text-summarization
Language:Python 8
styfeng / SAPPHIRE
Code for SAPPHIRE: Approaches for Enhanced Concept-to-Text Generation (https://aclanthology.org/2021.inlg-1.21/) INLG 2021 Best Long Paper.
machine-learning deep-learning natural-language-processing artificial-intelligence generative-model controllable-generation inlg2021 concept-to-text commongen generative-commonsense-reasoning commonsense-reasoning seq2seq language-model transformers natural-language-generation nlg language-modeling keywords-to-text constrained-text-generation data-to-text
8
styfeng / SMERTI
Code for SMERTI for Semantic Text Exchange.
semantics transformers rnn generative-model machine-learning natural-language-processing deep-learning artificial-intelligence emnlp2019 controllable-generation amazon-reviews news-headlines semantic-text-exchange text-infilling mask-language-modeling
Language:Jupyter Notebook 6
vita-epfl / CODE
Implementation of CODE: Confident Ordinary Differential Editing
aaai2025 controllable-generation diffusion-models image-editing image-generation image-manipulation image-restoration langevin-dynamics pytorch
Language:Jupyter Notebook 6
chao1224 / GraphCG
Unsupervised Discovery of Steerable Factors When Graph Deep Generative Models Are Entangled, TMLR 2024
controllable-generation graph molecular-graph molecule point-clouds contrastive-learning editing lead-optimization function-group-editing shape-editing
Language:Python 4
eric-ai-lab / Mojito
Official repo for the paper "Mojito: Motion Trajectory and Intensity Control for Video Generation""
controllable-generation diffusion-models motion-control text-to-video-generation video-generation
3
YuweiYin / TTIDA
TTIDA: Controllable Generative Data Augmentation via Text-to-Text and Text-to-Image Models
controllable-generation generative-data-augmentation text-to-image-generation text-to-text-generation
Language:Python 3