Boese0601 / RC-MVSNet

[ECCV 2022] RC-MVSNet: Unsupervised Multi-View Stereo with Neural Rendering

Home Page:https://boese0601.github.io/rc-mvsnet/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Problem with reproducing "tanksandtemples" results

notmuchnerdy opened this issue · comments

Hi,

I have reproduced the "tanksandtemples" .ply files according to the definition (without changing any parameter) on the main page of the RC-MVSNet. But unfortunately, I could not get meaningful results. I have uploaded a wide screenshot that depicts the results.

Results

You can see the depth estimates(left) and masks (right) on the left page. As you going to see here, Some of the depth estimates turn empty. Even worse, I could only get very few meaningful masks and not surprisingly I can only get the result like the right screen.

I would be appreciated it if you would help me to solve this issue.

Sincerely.

What fusion did you use for point cloud generation? Did you use our provided fusion code and parameters, or other fusion e.g. gipuma fusion?

I used your provided code "eval_rcmvsnet_tanks.py" and with its own threshold parameters as you see below:

scans = ['Family', 'Francis', 'Horse', 'Lighthouse',
'M60', 'Panther', 'Playground', 'Train']

    image_sizes = {'Family': (1920, 1080),
                        'Francis': (1920, 1080),
                        'Horse': (1920, 1080),
                        'Lighthouse': (2048, 1080),
                        'M60': (2048, 1080),
                        'Panther': (2048, 1080),
                        'Playground': (1920, 1080),
                        'Train': (1920, 1080)}
    geo_mask_thres = {'Family': 6,
                        'Francis': 8,
                        'Horse': 4,
                        'Lighthouse': 7,
                        'M60': 6,
                        'Panther': 7,
                        'Playground': 7,
                        'Train': 6} # num_consistency
    photo_thres = {'Family': 0.9,
                        'Francis': 0.8,
                        'Horse': 0.8,
                        'Lighthouse': 0.8,
                        'M60': 0.9,
                        'Panther': 0.9,
                        'Playground': 0.85,
                        'Train': 0.9} # prob_threshold
    geo_pixel_thres = {'Family': 0.75,
                        'Francis': 1.0,
                        'Horse': 1.25,
                        'Lighthouse': 1.0,
                        'M60': 0.75,
                        'Panther': 1.0,
                        'Playground': 1.0,
                        'Train': 1.5}    # img_dist_thresh
    
    geo_depth_thres = {'Family': 0.01,
                        'Francis': 0.01,
                        'Horse': 0.01,
                        'Lighthouse': 0.01,
                        'M60': 0.005,
                        'Panther': 0.01,
                        'Playground': 0.01,
                        'Train': 0.01}   # depth_thresh

hi, @notmuchnerdy,I try to reproduce the results and run the eval_rcmvsnet_tanks.py, then I encounter the same problem with you.

I used your provided code "eval_rcmvsnet_tanks.py" and with its own threshold parameters as you see below:

scans = ['Family', 'Francis', 'Horse', 'Lighthouse', 'M60', 'Panther', 'Playground', 'Train']

    image_sizes = {'Family': (1920, 1080),
                        'Francis': (1920, 1080),
                        'Horse': (1920, 1080),
                        'Lighthouse': (2048, 1080),
                        'M60': (2048, 1080),
                        'Panther': (2048, 1080),
                        'Playground': (1920, 1080),
                        'Train': (1920, 1080)}
    geo_mask_thres = {'Family': 6,
                        'Francis': 8,
                        'Horse': 4,
                        'Lighthouse': 7,
                        'M60': 6,
                        'Panther': 7,
                        'Playground': 7,
                        'Train': 6} # num_consistency
    photo_thres = {'Family': 0.9,
                        'Francis': 0.8,
                        'Horse': 0.8,
                        'Lighthouse': 0.8,
                        'M60': 0.9,
                        'Panther': 0.9,
                        'Playground': 0.85,
                        'Train': 0.9} # prob_threshold
    geo_pixel_thres = {'Family': 0.75,
                        'Francis': 1.0,
                        'Horse': 1.25,
                        'Lighthouse': 1.0,
                        'M60': 0.75,
                        'Panther': 1.0,
                        'Playground': 1.0,
                        'Train': 1.5}    # img_dist_thresh
    
    geo_depth_thres = {'Family': 0.01,
                        'Francis': 0.01,
                        'Horse': 0.01,
                        'Lighthouse': 0.01,
                        'M60': 0.005,
                        'Panther': 0.01,
                        'Playground': 0.01,
                        'Train': 0.01}   # depth_thresh

Hi, I met the same situation previouly. It is caused by depth range in the "cam.txt" of TAT.

1

Same Problem