The purpose of the project is to facilitate learning new languages through computer-assisted language learning. The idea of the project is to build an app that detects and translates objects in real time. For object detection we use YOLO model trained on the COCO dataset. For the laptop version of the app we use YOLOv5 and for the android version we use YOLOv4 with TFLite because it's computationally less demanding. For trying out the app(s) refer to the next section
Intall the requirements via pip3 install -r requirements.txt and then run python3 main.py
Download and install the apk from google-drive
We also added an option for detection on image (static not real-time) with Yolo 9k which can detect up to 9000 classes!
In order to build and test the model, you need to run the following commands:
> build.sh
> detect.sh image_name.jpg
Note that the image has to be inside testing_images directory.
