wzmsltw / BSN-boundary-sensitive-network

Codes of our paper: "BSN: Boundary Sensitive Network for Temporal Action Proposal Generation"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

question about poolData

ideaRunner opened this issue · comments

Hi, Tianwei Lin
Thanks for your BSN codes sharing.
From paper and the function poolData code in this project, I noticed that there is another operation before you pass TSN features to BSN network.
That operation does interpolation from var-length TSN feature to fixed-length processed feature.

I have read your BSN paper and ActivityNet 2017 paper, but can't find much instruction about that.
Can you give me some reference for it? Any paper or forum discussion will be appreciated.

Another question, as BSN network accepted fix-length feature, how about extract fixed number of frames (and optical flow) for every single video (comparison to extract 1 snippet every 16 frames)?
I think the poolData function, after the TSN feature extraction stage, is the reason why we need to use a pre-trained TSN network. otherwise, we can train the feature extraction network (RGB and Flow) together with the BSN (and BMN ) network online, which may achieve better results.