frank-xwang / InstanceDiffusion

[CVPR 2024] Code release for "InstanceDiffusion: Instance-level Control for Image Generation"

Home Page:https://people.eecs.berkeley.edu/~xdwang/projects/InstDiff/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Can you privide a simple demo json for training your model

zhengziqiang opened this issue · comments

Could you please provide a simple json file for training to let us know what kind of data structure is needed?

The json file could contain some meaningless placeholders. Just let us know the input structure is ok. Thank you for your help in advance

Because I am following your instructions.

I found no "Tag2Text" directory in GroundedSAM

line 29 in "dataset-generation/submitit_automatic_label_ram_save_json.py",

It is really confusing.

Really cannot run the data generation following your instructions. Could you please help with this? Or just provide some demo jsons?

Hi, the third-party repo Grounded-SAM removed Tag2Text in their recent updates :-( . To use our old dataset generation code, you might need to clone an earlier version of GroundedSAM.

But good news! I've updated the InstanceDiffusion repo to support dataset generation with the latest Grounded-SAM version. Check out the updated guide in dataset-generation/README.md and see this commit for details on the changes made for compatibility with the latest GroundedSAM version.

Please don't hesitate to reach out with any further questions or issues.

Thank you for your help. The code can run successfully but I met the out-of-memory issue. I plan to do this step-by-step.

Hello do you get the training data successfully?

Hello do you get the training data successfully?Could you please provide a simple json file for training to let us know what kind of data structure is needed?I am plan to generat data by myself.