mode="normal" , trunc_normal_thresh=None |
![](https://private-user-images.githubusercontent.com/67457712/307385892-e3e4731d-98cc-41de-b63b-9d3136bcbaed.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDczODU4OTItZTNlNDczMWQtOThjYy00MWRlLWI2M2ItOWQzMTM2YmNiYWVkLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTRmYmU5YmY3N2I0YzZjOGQ1YmE3YzUzOThhYWM4MDA0YjFhZWRkODQwY2QxYzgwZWE2MDEyNTBlNGM0NDgzN2MmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.fiAu8ugYP0RDIHnwH3GeTh1rZ-wQP8s8nlyj8JsmtJk) |
3) "interpolation_on_grid" Mode
mode="inerpolation_on_grid" |
![](https://private-user-images.githubusercontent.com/67457712/307383630-127dc5a2-4b56-4d59-af74-460848aceb50.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDczODM2MzAtMTI3ZGM1YTItNGI1Ni00ZDU5LWFmNzQtNDYwODQ4YWNlYjUwLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWU1ZTc5ZDY5NDU2MzQ5OTYyNWUwZDFhNmNlODVjZDJjZDJhNjVmY2E2YWIwNzVmNmIzYmU3MDk2ZGRjZGNkM2UmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.hQC-zArAwVBQX-QBXQ1AS1GxsHRRtvyr5YV8iIfwvVo) |
![](https://private-user-images.githubusercontent.com/67457712/307384769-40a5c5a9-379b-4fd8-9659-1dc933e48c3e.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDczODQ3NjktNDBhNWM1YTktMzc5Yi00ZmQ4LTk2NTktMWRjOTMzZTQ4YzNlLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWQ2MTVkOGJkMzIyZjEzZDg0NmU3ODMzYzM2MzlhZDE2N2FkMTg1YTk3YWE2MWU1ZjBjZjY3NDk2ODIyOWM3MWImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.KAG0YFDWc3GGsThAzfIMHB-FYhPExU_qN_Sm82Hbii0) |
mode="normal" , trunc_normal_thresh=0.1 |
mode="normal" , trunc_normal_thresh=0.5 |
![](https://private-user-images.githubusercontent.com/67457712/307842777-0cc7a638-996b-4ce1-b5c1-146e4249e962.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDc4NDI3NzctMGNjN2E2MzgtOTk2Yi00Y2UxLWI1YzEtMTQ2ZTQyNDllOTYyLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWVhM2U3Njg0YTIxZjM0MzkwYzQ1NTM2ZjRkZGE3OWQ3OTU2MDM5MTc2N2UyZDQ5NzkxNmU2NjBmYmY2MDUzMGImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.pKDnuoXO-j0RZOrorkTJX-zWaGmxm2g9Kk2pBYAhNfo) |
![](https://private-user-images.githubusercontent.com/67457712/307842772-187e88b5-fc00-4e9e-bc32-3f9ceaec9d2c.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDc4NDI3NzItMTg3ZTg4YjUtZmMwMC00ZTllLWJjMzItM2Y5Y2VhZWM5ZDJjLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWNiODNiMDk2NTljOWRlYzg3OGQ2ZjM3YmU5MzI1YmJkYTJmYTc0N2M3MTFkOTgxZDRiZDllNDhkZjM5NDM5ZDgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.mrQDJCIpCq7zpNEfKuJdkZYgDQ-XkTy8S7GOFeuMXKA) |
mode="normal" , trunc_normal_thresh=1 |
mode="normal" , trunc_normal_thresh=1.5 |
![](https://private-user-images.githubusercontent.com/67457712/307843381-7104e158-28fe-43e2-8051-e8f6a49908eb.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDc4NDMzODEtNzEwNGUxNTgtMjhmZS00M2UyLTgwNTEtZThmNmE0OTkwOGViLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPThlYjBlNWU1ODNjYjRkZDUxYzIxZjQ4MTY3NzJjZjUxNjVjOTQ3OGY3NjI2NGU1NzZjMWY4NTA2MGRjMmRiYjcmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.BtvueEwwUiLnNjkVwpHzhtJVV3tt3c7NhZv31rKp3Z0) |
![](https://private-user-images.githubusercontent.com/67457712/307843844-0b6585d8-db1a-46e0-b85c-a9622d4f379d.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDc4NDM4NDQtMGI2NTg1ZDgtZGIxYS00NmUwLWI4NWMtYTk2MjJkNGYzNzlkLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTVkZThjNjIzYjQyMjUzNjM3NzYwMzBiNjhlNmIzYjZkMGUxMDc4ZGVlNjUwZGYxYzI3NmZjNWUyZDNlZjM1NDQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.rsA7BWeOo8shJC-FU-GeRyoGezr2mp3lLGcC2Irb8d0) |
mode="normal" , trunc_normal_thresh=2 |
mode="normal" , trunc_normal_thresh=2.5 |
![](https://private-user-images.githubusercontent.com/67457712/307844606-748f8e04-e5b2-4824-aaf2-a9fed04796a7.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDc4NDQ2MDYtNzQ4ZjhlMDQtZTViMi00ODI0LWFhZjItYTlmZWQwNDc5NmE3LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTVkNTQ0NWVlMTU0OWM2YTdiYTZkMWQwMzEzYWVlOTlkMDVmNmRjNjVhOTc4OGU3N2JhMjQxYjVmZjg3NDZjMGImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.X-OyzJiNktHqGULuLlAKNkvz-TdK5yj8tmf7cw8qlyo) |
![](https://private-user-images.githubusercontent.com/67457712/307844599-89dcba0c-1779-42e2-9693-c6f12c735c02.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDc4NDQ1OTktODlkY2JhMGMtMTc3OS00MmUyLTk2OTMtYzZmMTJjNzM1YzAyLmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTNkMWI4Zjk0MGQxYjk3MGQ1MzVhZTc1ZGVkMDAwYWM3MTllMjI3Mzk2ZGIzYmQxMmFlY2Y3YmQ5OTEyMTczYzYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.xNrcfAnUB5O90H79owGouYbsOF2nLxES_cigXVvFnjc) |
mode="normal" , trunc_normal_thresh=3 |
![](https://private-user-images.githubusercontent.com/67457712/307848392-f2d4a0d6-9f29-459f-89ef-ef95f2e39f77.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTkzNDg0OTgsIm5iZiI6MTcxOTM0ODE5OCwicGF0aCI6Ii82NzQ1NzcxMi8zMDc4NDgzOTItZjJkNGEwZDYtOWYyOS00NTlmLTg5ZWYtZWY5NWYyZTM5Zjc3LmpwZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjUlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI1VDIwNDMxOFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTM3ODQwNjM3MTRkZTMwMjQ0MmE5Y2RkMThmZjhhZDk3MTYxNmVjMmU1ZjVjZjNiM2Y1NTMyMWQ3MDAyMzVkZjYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.snOF9LGtaoNntuv7FOLVdOBfQRWvcxeeMBQhy7By5p8) |
3. Theoretical Background
- "Predicted $x_{0}$":
$$\frac{x_{t} - \sqrt{1 - \alpha_{t}}\epsilon_{\theta}^{(t)}(x_{t})}{\sqrt{\alpha_{t}}}$$
- "Direction pointing to $x_{t}$":
$$\sqrt{1 - \alpha_{t - 1} - \sigma_{t}^{2}} \epsilon_{\theta}^{(t)}(x_{t})$$
1) Backward (Denoising) Process
$$x_{t - 1} = \sqrt{\alpha_{t - 1}}\Bigg(\frac{x_{t} - \sqrt{1 - \alpha_{t}}\epsilon_{\theta}}{\sqrt{\alpha_{t}}}\Bigg) + \sqrt{1 - \alpha_{t - 1}}\epsilon_{\theta}$$