How to reconstruct the background scene and how to render custom poses?
zjj421 opened this issue · comments
zjj421 commented
Hello, thanks for your work!
I'm new to this direction, I have 2 question:
- When I have trained the cutom scene model, how to use the trained scene model to reconstruct the background scene(Remove the human in the image), is there some code to do this?
- After trained the custom scene model and human model, how to render the novel poses or other custom poses. ("python render_reposing.py --scene_dir ./data/custom_data --weights_path ./out/custom_data_human/checkpoint.pth.tar --motion_name=jumpandroll
" can not get satisfactory result.)Can you teach me what to learn to do this?
Wei Jiang commented
- Yes, you can refer to this code snippet:
ml-neuman/trainers/vanilla_nerf_trainer.py
Lines 155 to 165 in 0149d25
render_vanilla
function. - To render novel poses, you need to manually align the human/motion to the scene. You can refer to: #42 and #26