wvangansbeke / Sparse-Depth-Completion

Predict dense depth maps from sparse and noisy LiDAR frames guided by RGB images. (Ranked 1st place on KITTI) [MVA 2019]

Home Page:https://arxiv.org/pdf/1902.05356.pdf

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Training with Confidence for Global and Local Networks

saikumar96 opened this issue · comments

From the paper:
"We first train both parts of the framework individually and use a pretrained ERFNet on Cityscapes [22] for our global network."
I was wondering how global and local networks are trained whether with or without confidence maps and how is the final end to end training done, with these pre-trained sub-networks

Hi @saikumar96,

Yes you are right. Both parts can be trained individually and later everything can be trained together. When you use skip connections between the local and global network, it's not that important. Differences are negligable. This version can be trained end-to-end without problem.

Best,
Wouter

Hi @wvangansbeke

What I want to know is whether you first train global net and local net separately, and the combine then for end to end?

Hi @LiangliangGuo,

I initially did it like you described.
Now in the latest version, I simply trained it end-to-end. It should give you the same numbers.

Best,
Wouter

@wvangansbeke Thank you very much for your kind answer!!!