Gaussian splatting with 360 camera
inuex35 opened this issue · comments
Hello,
I recently succeeded in implementing Gaussian splatting for 360-degree cameras.
Although there is no academic paper, would it be possible to add this to the repository?
Could you explain the implementation a little?
From what I've read from the issues, you still have to convert the 360 images to perspective images, can you clarify?
Hello,
Thank you for your response.
A week ago, it was necessary to convert to perspective images, but a few days ago, 360 diff rasterization was completed, and it is now possible to render directly to equirectangular images.
While the training parameters and other aspects are still being adjusted, the implementation seems to be going well.
The key idea is almost the same with this paper but the implementation seems different from this one.(This is not my paper and my focus is outdoor mapping)
360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roaming
https://arxiv.org/abs/2402.00763
Project 3D splat onto a unit sphere, I added render_spherical to render an equirectangular image.
Great!
I've added it to Other Implementations 8db839f
Perhaps you can add the youtube video link on the github page.
You may be interested in "OmniGS: Omnidirectional Gaussian Splatting for Fast Radiance Field Reconstruction using Omnidirectional Images"