12dmodel / deep_motion_mag

Tensorflow implementation of Learning-based Video Motion Magnification

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

why res_manipulator returns enc_b + diff rather than enc_a + diff?

kkjh0723 opened this issue · comments

In modules.py, I found that res_manipulator returns enc_b + diff rather than enc_a + diff (line 38).
According to the eq. 3 in the paper, isn't the later correct?
I might understand wrong...

Thank you. I understand.

To be very serious, it should only be enc_b + diff.
Suppose we have frame _ A/B/C/M in the given coco dataset, there is color perturbation between A and M. The perturbation was designed as a regularization for extracting motion better, instead of aiming to output an additional perturbation.
And if you check the amplification, enc_b + diff is also the one should be chosen.

link to this confusion.