VITA-Group / GNT

[ICLR 2023] "Is Attention All NeRF Needs?" by Mukund Varma T*, Peihao Wang* , Xuxi Chen, Tianlong Chen, Subhashini Venugopalan, Zhangyang Wang

Home Page:https://vita-group.github.io/GNT

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Rendering results of nerf_synthetic lego validation dataset by provided single-scene model

leo-frank opened this issue · comments

commented

Description:

I use the pretrained model that you provided at lego synthetic by provided single-scene model at https://drive.google.com/file/d/1IbhbBr5XfxQz0jSQM3nLX_htTbvc59kj/view?usp=share_link
the command is:
CUDA_VISIBLE_DEVICES=2 python3 eval.py --config configs/gnt_blender.txt \ --eval_dataset nerf_synthetic \ --eval_scenes lego --run_val\ --expname gnt_author_pretrained_single_lego \ --ckpt_path out/gnt_lego_from_single_ckpt/pretrained_lego_model_435000.pth \
(gnt_blender.txt is not modified)

Results:

  1. rendering results on validation set seems not correct, since the color has some green

image

  1. but the metrics seems resonable as this screenshot shows:

image

Questions:

I wonder the cause of such unexpected rendering results.Is it caused by my command or anything else?

Have you solved this issue? it happens all the same using gnt_full model as a checkpoint model.

No, I can't solve it. I tried 3 types of model:

  1. single-scene model provided by author
  2. cross-scene model provided by author
  3. single-scene model trained by myself
    all of these have the same issues.