some artifacts in generate ground truth data

Question

some artifacts in generate ground truth data

conson0214 opened this issue 5 years ago · comments

I try to use ./SomeISP_operator_python/ISP_implement.py to generate synthetic noisy image & ground truth image(gt), but in many images, i saw artifacts like this

and the raw srgb noisy-free image is like this

I wonder if these artifacts are reasonable in synthetic ISP process, and why these happens?

Shi Guo · Answer 1 · Tue Jul 16 2019 16:48:35 GMT+0800 (China Standard Time)

In Python code, the clean image is converted to RAW and then convert back to the sRGB image. In my understanding, these artifact is caused by the demosaic process. In original Matlab code (strictly following the paper), the original sRGB image is directly treated as groundtruth image. However, when I read more paper, the original setting is kindly like denoising+demosaic, so in the python code, I change a little bit. You can try to use python code to train or directly use original RGB as groundtruth (as in my paper), if you find other questions, please feel free to contact me.

MengXinChengXuYuan · Answer 2 · Wed Jul 17 2019 17:33:26 GMT+0800 (China Standard Time)

Hi thank you for your great work first!
Actually it seems that you are taking the rgb values from sRGB image and putting them in the corresponding Raw RGB location, and I don't think it's a real inverse process of demosaicing in ISP, thus caused the shown artifacts

conson0214 · Answer 3 · Wed Jul 17 2019 18:07:52 GMT+0800 (China Standard Time)

Hi thank you for your great work first!
Actually it seems that you are taking the rgb values from sRGB image and putting them in the corresponding Raw RGB location, and I don't think it's a real inverse process of demosaicing in ISP, thus caused the shown artifacts

Hi, thanks for your concern about this issue.
I wonder if its not a real inverse process of demosaicing in ISP, whats the real inverse process like?
If you may supply some improving direction?

MengXinChengXuYuan · Answer 4 · Wed Jul 17 2019 18:59:00 GMT+0800 (China Standard Time)

Hi thank you for your great work first!
Actually it seems that you are taking the rgb values from sRGB image and putting them in the corresponding Raw RGB location, and I don't think it's a real inverse process of demosaicing in ISP, thus caused the shown artifacts

Hi, thanks for your concern about this issue.
I wonder if its not a real inverse process of demosaicing in ISP, whats the real inverse process like?
If you may supply some improving direction?

https://link.springer.com/article/10.1007/s11263-017-1056-0, check this out
A fully inverse of demosaicing is not a simple thing, but if you only want to make a simulation, you can just fellow demosaicing process since it's just a non-linear process, or more precise, interpolation process.
In my opinion, if the two process match, there won't be any artifacts