HappyDay is the frontend to the HappyDay project. The app has been created because it allows to collect as much training data as possible for the neural networks. Every cool programmer is in possession of an Android smartphone and can download the app. Be it on the way or cosy at home in front of the TV: You get the mobile phone out, start the app and take some pictures.
- Android Smartphone with Camera
- Android Version >= 5.0 (Lollipop)
- Internet Connection
To make it quick and easy to take pictures with the app, the camera has been integrated into the app directly via theCameraFragment. Thus, the images do not have to be retrieved via Intent from standard camera apps.
The app works as shown in the figure.
When a photo has been taken, the face is recognized and cropped using vision tools from the Android SDK. This reduces unnecessary overhead because the background usually contains no information about the emotions.
Now you can label the emotion on the photo and send it to the cloud to extend our trainings data by hitting the Cloud-Uplode button. The date is send over http to our Server.
To test the emotions classification, the image can also be sent to the server without labeling by clicking on the tensorflow button. Then the image is classified by the CNNs in the server and sends the result back to the app.