yiqun-wang / HFS

HF-NeuS: Improved Surface Reconstruction Using High-Frequency Details (NeurIPS 2022)

Home Page:https://arxiv.org/abs/2206.07850

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Code released

zhao-yiqun opened this issue · comments

Congratulations on your amazing results and acceptance for Neurips 2022, I wonder what is your code releasing plan, eg. when will you release the code? Can't wait to use your amazing projects! Thank you.

Thank you for your attention, we will release the code soon.

Hi, I understand that you may be busy with other work, therefore I try to reproduce your work, since it seems not hard based on NeuS. Here summarize a few detail questions, and I hope you can give me some quickly reply :

1).Your paper did not mention about the background modeling as NeuS use a nerf++ for background modeling. I wonder how you deal with the background in the dataset as DTU at training time.

2).You have implement 2 MLP for SDFnetwork for displacement, I wonder how you deal with them when you implement feed them into the color network for volume rendering. Which density you choose for volume rendering? Or make some combination with both of them?

3). For the sampling strategy, As you mentioned in your paper "then adaptively update the weight according to the gain and sample an additional 64 points". Are these 64 points sampled as Neus did? eg. construct the pdf, and gradually sample 16*4 points near the surface. Does it mean you just have changed the Transparency weights using the eq.16 in the paper while other is the same as neus did.

4). In the eqution 14, why there is a scale term 4 at MLP_d, what will happen if it become larger or smaller, I guess you may try other scales, could you share the design about that?

Sorry for asking so many problems, Since I am following your work and try to extend it for Scene-level reconstruction, I wish you can give me some quick advice.

Looking forward to your kindly reply

Thanks for your interest,

1). We use the same way as NeuS to model background,

2). Eq. 14 is used for the combination of two SDFs.

3). Sec. 3.1 shows the difference between others.

4). The term 4 is applied for normalizing the maximum constraint to 1.

We are going to release the cleaned code next week. Cheers.

Thanks for your quick reply and your code releasing plan, (it seems some questions are just my misunderstanding), Any way your reply made me clear to understand, And now I will closs the issues, Thank you very much, and looking forward to your cleaned code next week!

Hi there,

Will your code be released this week?

Since my reproduced quality is not very well, I need your implementation for refrence, thank you !

Looking forward to your reply

Following your details in your paper, here is my reproduced results on blended MVS man.
image
image

Here is the results from NeuS:
image
image

The back of the head is not well reconstructed, I think it's some of my missunderstanding for your work, Therefore, I am looking forward to your implementation released. Or if you have meet the same issues, could you please simply point the possible problems?

Hi, today I am preparing some important materials to complete neurips requirements. I have cleaned up the code and will release the code tomorrow evening.

Thanks for your code releasing.