johannakarras / DreamPose

Official implementation of "DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How did you train model specifically? And when fine-tuning on both UNet and VAE, did you also just use the single frame_50.png image to finetune?

zhangtao22 opened this issue · comments

I downloaded the base model and strictly followed the steps in your "Finetune on Sample" guide, but the resulting images are whitening and flickering.

I have recently tested and re-uploaded necessary finetuning scripts. The result is in media/demo.gif. Please let me know if these updates do not solve your issue!

@johannakarras The issue of whitening is solved.Nice!But the issue with wired movements still persists.