Training on 4K resolution

[Avik Kuthiala]

Hi! I'm trying to train on scenes with higher resolution, but getting worse results. What changes/optimizations do you suggest to achieve better reconstruction on 2K or 4K images?

Thanks!

[Tao Lu]

Hi, could you clarify if the 'worse results' are in comparison to Scaffold's performance on lower resolution images or against 3D-GS in the same higher resolution?

[JasonY]

Hi! I'm trying to train on scenes with higher resolution, but getting worse results. What changes/optimizations do you suggest to achieve better reconstruction on 2K or 4K images?

Thanks!

I believe there is a control in CameraUtil to prevent training and evaluating resolution go beyond 1600 (in width), therefore, if you try to extend the resolution, you have to change that part.

GPU memory increase quickly using higher resolution.

[Avik Kuthiala]

I am aware of that flag. 2K images training takes a very high memory. @inspirelt I meant the 'worse results' were as compared to Scaffold's performance on 1K resolution. I tried tweaking some hyperparameters like update_hierachy_factor, update_init_factor, update_depth, voxel_size, n_offsets, appearance_dim but got no success.

There's a similar trend in the 3D-GS pipeline too I agree.

[Tao Lu]

Did you try to train for longer iterations? Since more details are presented in a higher resolution image, Scaffold-GS may need more growing operations.