daydreamer2023 / Pose-Warping

Code to warp a frame from a source view to the target view

Pose-Warping for View Synthesis / DIBR

Code to warp a frame from a source view to the target view, given the depth map of source view, camera poses of both views and camera intrinsic matrix.

Features:

1. The warping is implemented in python using numpy/pytorch package and has been vectorized.
2. It uses inverse bilinear interpolation (which can be considered as a trivial form of splatting).
3. Pytorch implementation is differentiable.
4. Also contains splatting/interpolation code given flow and/or depth.
5. Supports warping of masked frame/flow i.e. if frame/flow is unknown at certain pixels.

Other implementations:

1. Reference View Synthesizer (RVS)
2. Open MVS
3. A splatting based differential warping has been implemented by PyTorch 3D which has been used in SynSin
4. Softmax Splatting

Citation

If you find this work useful, please cite it as

@misc{somraj2020posewarping,
    title = {Pose-Warping for View Synthesis / {DIBR}},
    author = {Somraj, Nagabhushan},
    year = {2020},
    url = {https://github.com/NagabhushanSN95/Pose-Warping}
}