wangzheallen / denseflow

Extracting optical flow and frames

Denseflow

Extracting dense flow field given a video.

Features

• support multiple optical flow algorithms, including Nvidia hardware optical flow
• support single video (or a frame folder) / a list of videos (or a list of frame folders) as input
• support multiple output types (image, hdf5)
• faster, 40% faster (by parallelize IO & computation)
• record the progress when extract a list of videos, and resume by simply running the same command again (idempotent)

Install

Dependencies:

• OpenCV: opencv3 | opencv4
• CUDA (driver version > 400)
• Boost
• HDF5 (Optional)

git clone https://github.com/innerlee/denseflow
mkdir build && cd build
cmake -DCMAKE_INSTALL_PREFIX=$HOME/app -DUSE_HDF5=no -DUSE_NVFLOW=no ..
make -j
make install

If you have trouble setting up building environments, scripts in INSTALL might be helpful.

Usage

Extract optical flow of a single video

denseflow test.avi -b=20 -a=tvl1 -s=1 -v

• test.avi: input video / videolist.txt
• tmp: folder containing RGB images and optical flow images
• dir: output generated images to folder.
• tvl1: optical flow algorithm
• v: verbose
• s: step, extract frames only when step=0

Extract optical flow of a list of videos

• resize
• class folder
• input image

denseflow videolist.txt -b=20 -a=tvl1 -s=1 -v

• videolist.txt: input video / videolist.txt
• tmp: folder containing RGB images and optical flow images
• dir: output generated images to folder.
• tvl1: optical flow algorithm
• v: verbose
• s: step, extract frames only, when step=0

Documentation

$ denseflow -h
GPU optical flow extraction.
Usage: denseflow [params] input

        -a, --algorithm (value:tvl1)
                optical flow algorithm (nv/tvl1/farn/brox)
        -b, --bound (value:32)
                maximum of optical flow
        --cf, --classFolder
                outputDir/class/video/flow.jpg
        -f, --force
                regardless of the marked .done file
        -h, --help (value:true)
                print help message
        --if, --inputFrames
                inputs are frames
        --newHeight, --nh (value:0)
                new height
        --newShort, --ns (value:0)
                short side length
        --newWidth, --nw (value:0)
                new width
        -o, --outputDir (value:.)
                root dir of output
        -s, --step (value:0)
                right - left (0 for img, non-0 for flow)
        --saveType, --st (value:jpg)
                save format type (png/h5/jpg)
        -v, --verbose
                verbose

        input
                filename of video or folder of frames or a list.txt of those

Citation

If you use this tool in your research, please cite this project.

@misc{denseflow,
  author =       {Wang, Shiguang* and Li, Zhizhong* and Zhao, Yue and Xiong, Yuanjun and Wang, Limin and Lin, Dahua},
  title =        {{denseflow}},
  howpublished = {\url{https://github.com/open-mmlab/denseflow}},
  year =         {2020}
}

Acknowledgement

Rewritten based on yuanjun's fork of dense_flow.