To develop a face recognition program that can identify multiple people.
The following work is adopted from various past works from tensorflow contributions and research papers to develop the face recognition program that has been trained on 6 celebrities with very few training dataset and to test on images and video file to determine the model performance. The program is able to recognize upto an accuracy of 96% !!!
The sample images of various celebrities like Bill Hader, Bobby Moynihan, Jason Sudeikis, Kate McKinnon, Kenan Thompson, Kristen Wiig are from various sources. These data contains a large variance so that the model learns maximum features with no bias in the images. I've tried to obtain faces with glasses, makeup, lots of expressions like laugh, smile, sad, angry, neutral, side angles so on to avoid biasness in recognizing the faces from single point of view.
This data is stored in the directory "Raw Images" with labels as the directory names within the raw_images directory. These labeled directories contain upto 25 images of these people with different backgroud textures.
| Bill Hader | Bobby Moynihan | Jason Sudeikis |
|---|---|---|
 |
 |
 |
| Kate McKinnon | Kenan Thompson | Kristen Wiig |
|---|---|---|
 |
 |
 |
run the step 1 ipynb file
- The images are sent to preprocess library which uses the detect faces, facenet mudules in the library which convolves with pretrained weights stored in form of .npy in the npy folder to detect the faces in a given image(suppose to contain single person to append with the class/person_name label)
- Once the face is detected, the facenet module and detect faces mudule marks the boundaries of the face in the image and crops at the boundary and saves in the "face_dataset" directory
run the step 2 ipynb file
*The model file is large to upload, for time being it is refered from gdrive share. The file name in this folder should be "20191012-185253.pb" This readme file should be deleted once the modle file is placed in the model directory for limiting the execution errors. Access file from: https://drive.google.com/open?id=1QXCPcUVt5l_h_JC92mL-vg05nlwyyC7e *
run Step 3 - Recognizing Faces in an Image File.ipynb which contains the name of the file as "example_02.jpg"
Accuracy : [0.93148507] 'Bill_Hader'
Accuracy : [0.93587521] 'jason_sudeikis'
Accuracy : [0.91804383] 'Kate_McKinnon'
Accuracy : [0.93157867] 'bobby_moynihan'
Accuracy : [0.93045618] 'jason_sudeikis'
Accuracy : [0.83106043] 'kenan_thompson'
Accuracy : [0.9621055] 'kristen_wiig'
Accuracy : [0.5370428] 'Kate_McKinnon'
.JPG)
Video Name: "Fox News: End of an Era - SNL" and the Url: https://www.youtube.com/watch?v=2j3beRaYExU
The video file inputted is : "example_mov.avi"
The output result is : example_mov Result(fast forwarded).avi Available at my YouTube channel- https://youtu.be/1UOTxPbqT84
Two snapshots of the result video file:
Recognised "Jason Sudeikis"
Since the model is not trained to recognize "Fred Armisen", the actor was not recognized by the model:
Accuracy Results for the face recognition in the video file is saved in the respective ipynb file : "Step 3 - Recognizing Faces in each frame of a video file.ipynb"
Some Experimented model comparison and performances is discussed in my GitHub repo, where the how the FaceNet performed wrt accuracy and the loss. https://github.com/E-B-Manohar/Object-Classification-with-Keras-using-Transfer-Learning
More research on this will be updated.
References of various codes, research:
- https://github.com/davidsandberg/facenet
- http://www.aisangam.com/blog/real-time-face-recognition-using-facenet/
- A Discriminative Feature Learning Approach for Deep Face Recognition
- Deep Face Recognition
- https://drive.google.com/open?id=1QXCPcUVt5l_h_JC92mL-vg05nlwyyC7e