tensorflow / flutter-tflite

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Feature Request] Video classification example

saurabhkumar8112 opened this issue · comments

Thanks for the awesome package

I was wondering if it's possible to add an example or make it possible to do video classification on the device using this plug-in.

I am aware that we can split a video into frames of images and then do processing(either 1by1 or in batches) on an image classification model to get the result on those frames, but that's not taking advantage of the temporal correlation between frames.

Essentially there's no way to do inferencing on a video directly, for instance for video classification.

Would be nice to have this feature!

@saurabhkumar8112 I made a very simple app that classifies the human action in realtime. This is very very initial version and lots of things should be optimized. you can refer to it just to understand how to process image stream and the structure of the model input/output (I put a lot of effort to figure out these...). I will optimize the app ASAP. Hope it helps.

https://github.com/yanghoonkim/flutter_pj/tree/main/realtime_video_classification

tysm @yanghoonkim , i am taking a look. Will try to contribute as well!