SainingZhang / UC-GS

[BMVC 2024 ] Drone-assisted Road Gaussian Splatting with Cross-view Uncertainty

Home Page:https://sainingzhang.github.io/project/uc-gs/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Drone-assisted Road Gaussian Splatting with Cross-view Uncertainty

Saining Zhang, Baijun Ye, Xiaoxue Chen, Yuantao Chen, Zongzheng Zhang, Cheng Peng, Yongliang Shi, Hao Zhao

[Project Page][arxiv]

Overview

We introduce UC-GS, a novel uncertainty-aware 3D-GS training paradigm to effectively use aerial imagery to enhance the NVS of road views.

Our method performs superior on details during viewpoint shifting.

Installation

We tested on a server configured with Ubuntu 18.04, cuda 11.6 and gcc 9.4.0. Other similar configurations should also work, but we have not verified each one individually.

  1. Clone this repo:
git clone https://github.com/SainingZhang/UC-GS.git --recursive
cd UC-GS
  1. Install dependencies
SET DISTUTILS_USE_SDK=1 # Windows only
conda env create --file environment.yml
conda activate uc_gs

Data

The Synthetic dataset is available in Google Drive.

Training

bash ./single_train.sh
  • scene: scene name with a format of dataset_name/scene_name/ or scene_name/;
  • exp_name: user-defined experiment name;
  • gpu: specify the GPU id to run the code. '-1' denotes using the most idle GPU.
  • voxel_size: size for voxelizing the SfM points, smaller value denotes finer structure and higher overhead, '0' means using the median of each point's 1-NN distance as the voxel size.
  • update_init_factor: initial resolution for growing new anchors. A larger one will start placing new anchor in a coarser resolution.

Evaluation

python render.py -m <path to trained model> # Generate renderings
python metrics.py -m <path to trained model> # Compute error metrics on renderings

Related Work

Scaffold-GS

About

[BMVC 2024 ] Drone-assisted Road Gaussian Splatting with Cross-view Uncertainty

https://sainingzhang.github.io/project/uc-gs/

License:Other


Languages

Language:C++ 73.5%Language:Python 10.3%Language:CMake 9.6%Language:Cuda 3.3%Language:GLSL 2.6%Language:C 0.4%Language:Gnuplot 0.1%Language:Batchfile 0.1%Language:Shell 0.1%