Tachionstrahl / SignLanguageRecognition

Real-time Recognition of german sign language (DGS) with MediaPipe

Home Page:https://www.hs-mainz.de

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

running demo on CPU

ishaghodgaonkar opened this issue · comments

Hello, thanks for the great work on this repo! I understand that the repository doesn't currently support CPU operations. I am getting this error when running the demo commands in the README:

I20201111 20:41:01.626775 480495040 demo_run_graph_main.cc:53] Initialize the calculator graph.
E20201111 20:41:01.632501 480495040 demo_run_graph_main.cc:146] Failed to run the graph: ValidatedGraphConfig Initialization failed.
SignLangPredictionCalculator::GetContract failed to validate:
For output streams ValidatePacketTypeSet failed:
Failed to get tag "" index 0
Tag "TEXT" index 0 was not expected.

I would like to get this working on my end, would you be able to let me know roughly what changes should be made and where to make it functional?

Thanks!

Actually never mind! I did get it to work on CPU for file processing and live demo. I can make a pull request soon unless you have already started implementing this.

Any ideas as to why it is slow/freezes? Where should I start looking to try and fix this issue?

Thanks so much!

Hi Isha,
thanks for submitting your issue.
Actually we do not work on a CPU version, simply because of the issue you're faced with.
We know that running on CPU is pretty slow. We assume the processing of face and hand recognition simultaneously in combination with the downstream prediction of signs is not performant on CPU. Maybe it's possible to develop a faster graph for the CPU variant.