Get flow between frames ref and other

Question

Get flow between frames ref and other

qtct opened this issue a year ago · comments

flows_list = [flow.view(b, n, 2, h // (2 ** (i)), w // (2 ** (i))) for flow, i in zip(flows, range(3))]
RuntimeError: shape '[4, 7, 2, 64, 64]' is invalid for input of size 8192

In the get_ref_flows function of bsrt.py，I had such a problem without any modification,what's wrong,thanks for your response.

balabala · Answer 1 · Sun Mar 05 2023 20:37:18 GMT+0800 (China Standard Time)

Hi,
Does this problem happen during training or testing？
Can also you print the flow sizes and x_ref's size?

qtct · Answer 2 · Sun Mar 05 2023 21:39:56 GMT+0800 (China Standard Time)

Thanks for your reply, The flow size is [28,2,64,64] and the x_ref size is [28,3,64,64]. One more thing,I changed the way the optical downsampled like above two pictures,does it also right? And I wonder the x_ref should be x_ref = x[:, self.center_frame_idx, :, :, :].repeat(1, n, 1, 1, 1).reshape(-1,c,h,w) rather than x_ref = x[:, self.center_frame_idx:self.center_frame_idx +1, :, :,:].repeat(1, n, 1, 1, 1).reshape(-1,c,h,w). That is my humble opinion.

…

------------------ 原始邮件 ------------------ 发件人: ***@***.***>; 发送时间: 2023年3月5日(星期天) 晚上8:37 收件人: ***@***.***>; 抄送: ***@***.***>; ***@***.***>; 主题: Re: [Algolzw/BSRT] Get flow between frames ref and other (Issue #10) Hi, Can also you print the flow sizes and x_ref's size? — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

balabala · Answer 3 · Sun Mar 05 2023 22:50:11 GMT+0800 (China Standard Time)

Aha. If your first flow size is [28, 2, 64, 64], it should be well reshaped to [4, 7, 2, 64, 64]. But where do you get the input size of 8192?

Here I use self.center_frame_idx:self.center_frame_idx +1 to keep the dim to perform the following repeat operation.

qtct · Answer 4 · Mon Mar 06 2023 10:02:45 GMT+0800 (China Standard Time)

Thanks for your reply. I found the reason is that my spynet had not been applied correctly. Does your DCNv2 code support Cuda 11?

…

------------------ 原始邮件 ------------------ 发件人: "Algolzw/BSRT" ***@***.***>; 发送时间: 2023年3月5日(星期天) 晚上10:50 ***@***.***>; ***@***.******@***.***>; 主题: Re: [Algolzw/BSRT] Get flow between frames ref and other (Issue #10) Aha. If your first flow size is [28, 2, 64, 64], it should be reshaped well to [4, 7, 2, 64, 64]. But where do you get the input size of 8192? Here I use self.center_frame_idx:self.center_frame_idx +1 to keep the dim to perform the following repeat operation. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

balabala · Answer 5 · Mon Mar 06 2023 17:03:56 GMT+0800 (China Standard Time)

Sure, you can refer to this repo to install DCNv2 for CUDA 11: #9 (comment)