anchen1011 / toflow

TOFlow: Video Enhancement with Task-Oriented Flow

Home Page:http://toflow.csail.mit.edu

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Confusion on Image Transformation Module

jarvislkm opened this issue · comments

Hi, according to the paper section 4.3, STN layer is used for transformation estimation. Seems the implementation you use in this repo only support affine transformation? So does it mean in Fig2 the "warped input" is just an affine transformation of "Input frames"?

Actually, we are using a full-resolution warping map, instead of the affine transformation. The implementation is at: src/stnbhwd/BilinearSamplerBHWD.cu, which is forked from original STN paper: https://arxiv.org/abs/1506.02025.