frank-xwang / InstanceDiffusion

[CVPR 2024] Code release for "InstanceDiffusion: Instance-level Control for Image Generation"

Home Page:https://people.eecs.berkeley.edu/~xdwang/projects/InstDiff/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How to run the train code, I get the follwing error? Do I need to configure an additional environment to run

heart-du opened this issue · comments

Traceback (most recent call last):
File "/home/ma-user/work/d00563493/code/InstanceDiffusion/run_with_submitit.py", line 123, in
main()
File "/home/ma-user/work/d00563493/code/InstanceDiffusion/run_with_submitit.py", line 83, in main
args.job_dir = get_shared_folder() / "%j"
File "/home/ma-user/work/d00563493/code/InstanceDiffusion/run_with_submitit.py", line 34, in get_shared_folder
raise RuntimeError("No shared folder available")

Hi, the shared folder should be the folder that is visible by all machines / nodes. You can change the path "/fsx-muvigen/" in line 30 to the shared folder in your env. You can also simply use your home directory if it is visible by all nodes.

thanks for reply, I also want know how to get projection_matrix.

Hi, projection_matrix (768*768) is the CLIP projection matrix, which should be weight.data of Linear layer defined in CLIP (out_dim, in_dim). We actually didn't use it in our codes.

Closing this issue now. Please feel free to re-open it if you have further questions.