Vchitect / Latte

Latte: Latent Diffusion Transformer for Video Generation.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Re-implementation err on ffs experiment

dummy702 opened this issue · comments

Good job, but I have some questions on ffs ckpt inference experiment.
1)I set "ckpt" in ffs.sh to the folder related to https://huggingface.co/maxin-cn/Latte/blob/main/ffs.pt", set "pretrained_model_path" to the folder related to https://huggingface.co/maxin-cn/Latte/tree/main/vae.
But the performance of video generation is bad. Is there anything wrong with my process?

sample.mp4

2)Besides, I edit the code in sample.py. If I keep the code "samples = vae.decode(samples / 0.18215).sample", I will get "Segmentation fault". Therefore, I replace the code with the following. Is there anything wrong with my process?
截屏2024-02-27 下午5 14 47

Good job, but I have some questions on ffs ckpt inference experiment. 1)I set "ckpt" in ffs.sh to the folder related to https://huggingface.co/maxin-cn/Latte/blob/main/ffs.pt", set "pretrained_model_path" to the folder related to https://huggingface.co/maxin-cn/Latte/tree/main/vae. But the performance of video generation is bad. Is there anything wrong with my process?

sample.mp4
2)Besides, I edit the code in sample.py. If I keep the code "samples = vae.decode(samples / 0.18215).sample", I will get "Segmentation fault". Therefore, I replace the code with the following. Is there anything wrong with my process? 截屏2024-02-27 下午5 14 47

I just tested my code and didn't find anything unusual. For the second question, perhaps you could reinstall your environment? Thanks for your interest.

sample.mp4