Demo code for the works below:
- Nie, Yongwei, et al. "Dynamic Video Stitching via Shakiness Removing." IEEE Transactions on Image Processing 27.1 (2018): 164-178.
- Su, Tan, et al. "Video stitching for handheld inputs via combined video stabilization." SIGGRAPH ASIA 2016 Technical Briefs. ACM, 2016.
Video Demo on YouTube:
Including video clips from previous works, see Readme.MD for more details)
- Shankar Rao's Motion Segmentation Code: http://perception.csl.illinois.edu/coding/motion/#Software
- CVX: http://cvxr.com/cvx/
- vlfeat: http://www.vlfeat.org/
- peter kovesi matlab toolbox: http://www.peterkovesi.com/matlabfns/
- Liu Shuaicheng's As-similar-as-possible Warping code: http://www.liushuaicheng.org/SIGGRAPH2013/index.htm
-
In the folder
/case-cuhk_lib, extract video frames of case17-l.mp4 to folder/left, and extract video frames of case17-r.mp4 to folder/right. After the frame extracation, each folder should contain 400 png files. The file names should be indexed properly. (e.g. 001.png 002.png ...) -
You may need to install
CVXif you have not. -
Set MATLAB path to
/Stitching-1.1.0, runRunStitching.m. The generated output frames will be in the auto-created subfolder under/case-cuhk_lib. (res_demoif you didn't change the output path). -
Build the OpenCV project in
/SeamCut(You need to set OpenCV's include and library path manually) and copy the executable (e.g.SeamCut.exe) to the folder containing the output frames (1.png, A1.png, B1.png, 2.png, A2.png, B2.png, ...). This program finds the continuous optimal seam by GraphCut algorithm and use OpenCV's multi-band blending function. -
Run
./SeamCut 5 1 400 1 0.2to see the final result. Blended frames are saved as D1.png, D2.png, ...
For more details, please read the comments
@article{nie2018dynamic, title={Dynamic Video Stitching via Shakiness Removing}, author={Nie, Yongwei and Su, Tan and Zhang, Zhensong and Sun, Hanqiu and Li, Guiqing}, journal={IEEE Transactions on Image Processing}, volume={27}, number={1}, pages={164--178}, year={2018}, publisher={IEEE} }
@inproceedings{su2016video, title={Video stitching for handheld inputs via combined video stabilization}, author={Su, Tan and Nie, Yongwei and Zhang, Zhensong and Sun, Hanqiu and Li, Guiqing}, booktitle={SIGGRAPH ASIA 2016 Technical Briefs}, pages={25}, year={2016}, organization={ACM} }
Code by Tan Su, Zhensong Zhang and Yongwei Nie. For research purpose ONLY.