chenhaoxing / DiffusionInst

This repo is the code of paper "DiffusionInst: Diffusion Model for Instance Segmentation" (ICASSP'24).

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

I don't find the code that adding gaussian noise to ground-truth instance kernel

MaverickRen opened this issue · comments

In the formula of the paper, you added gaussian noise to ground-truth kernel, but I did not find the generation of ground-truth kernel in the code, and the sampling process like DDPM, does this conform to the paradigm of diffusion model? The prediction of the bounding box offset in DiffusionDet can still be understood as denoising, but I found that in your code, the generation of the kernel is directly predicted with the ROI feature, and there is no denoising process. Maybe my understanding is wrong, I hope you can help me solve my doubts, Thank you.

@MaverickRen
Hi, in the caption of figure 2, we said "During training, we add random t step noise to the groundtruth boxes and pad them to predefined numbers. Instance-aware noisy filters are constructed by combining features and noisy boxes. "
Actually, the noisy instance filter is generated by noisy boxes and features. Thus, the adding noise and DDIM are now all based on bounding boxes. It is like "adding noise to gt_Box for noisy instance diffusion scheme".
We are now working on directly add noise to the instance itself.
By now, we will add an equation from noisy boxes to noisy instances to fix this error and update arxiv in a few days.