NVlabs / I2SB

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Confused about the sampling algorithm

Morefre opened this issue · comments

I understand the theories and how they come up with the algorithm. However, the resulting algorithm is very confusing. Just by looking at the algorithm 1 and 2, what IS2B actually does is training a diffusion model using VE-SDE as in equation (12). The only difference from standard VE-SDE is that they use a different forward process to generate data for training the network as in equation (11). That's it, nothing more.

It's surprising this method will work in practice since the data generation process is different from the defined forward SDE. Will the method still work if we design another data generation process instead of equation (11). Will the method still work if we change equation (12) to the training formula for VP-SDE and change the DDPM posterior formula in algorithm 2 to that of the VP-SDE?

So, basically I don't know how to understand I2SB correctly. Any discussion or correction will be appreciated !

image image image