Is that possible this work in real-time case

Question

Is that possible this work in real-time case

mathmax12 opened this issue 3 years ago · comments

Hi
Thanks for sharing the amazing work.
Does the work support real-time case?
If not what change do you recommend for that?
Thanks.

Rex Cheng · Answer 1 · Thu Sep 09 2021 04:49:28 GMT+0800 (China Standard Time)

Can you elaborate on what properties do your real-time case needs? (speed/online/long sequences?)

mathmax12 · Answer 2 · Thu Sep 09 2021 08:58:19 GMT+0800 (China Standard Time)

For example, processing the video stream from a camera in real-time 30FPS.

Rex Cheng · Answer 3 · Thu Sep 09 2021 09:45:49 GMT+0800 (China Standard Time)

Speed-wise, the current model can handle it with PyTorch's AMP enabled in the single object setting. But then there are also considerations regarding inputs (this is after all an interactive method) and memory (feature bank growing over time as in STM).

mathmax12 · Answer 4 · Fri Sep 10 2021 04:04:38 GMT+0800 (China Standard Time)

I see. Thanks for that.

…

On Wed, Sep 8, 2021 at 6:46 PM Rex Cheng ***@***.***> wrote: Speed-wise, the current model can handle it with PyTorch's AMP <https://pytorch.org/docs/stable/amp.html> enabled in the single object setting. But then there are also considerations regarding inputs (this is after all an interactive method) and memory (feature bank growing over time as in STM). — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#17 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AHW6H62U7WPB5ORSP5PTYQLUBAGVPANCNFSM5DVUHWZQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.