[Feature Request] Video classification example
saurabhkumar8112 opened this issue · comments
Thanks for the awesome package
I was wondering if it's possible to add an example or make it possible to do video classification on the device using this plug-in.
I am aware that we can split a video into frames of images and then do processing(either 1by1 or in batches) on an image classification model to get the result on those frames, but that's not taking advantage of the temporal correlation between frames.
Essentially there's no way to do inferencing on a video directly, for instance for video classification.
Would be nice to have this feature!
@saurabhkumar8112 I made a very simple app that classifies the human action in realtime. This is very very initial version and lots of things should be optimized. you can refer to it just to understand how to process image stream and the structure of the model input/output (I put a lot of effort to figure out these...). I will optimize the app ASAP. Hope it helps.
https://github.com/yanghoonkim/flutter_pj/tree/main/realtime_video_classification
tysm @yanghoonkim , i am taking a look. Will try to contribute as well!