miaiseman / doppel

A face recognition app for fan engagement of the Hobbs & Shaw movie

Home Page:http://www.doppeldoya.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Doppel Demo

Note: This is a fictional case study. All references to companies and movies are for our imaginary use case, though they are actual brands.

At MLW Studios, we drive consumer engagement through consumer experiences. Here we present our prototype to Universal Pictures for the premiere of their movie "Hobbs and Shaw: A Fast and Furious Film" Will use Doppel to increase brand awareness through potential customer experiences.

Goal:

Increase consumer engagement and brand awareness with the Doppel product, which allows consumers to instantly compare themselves to characters represented by your brand.

Business Need

Brand Awareness

Typically, the release of a Fast & Furious film is met with eager anticipation from fans. Based on the digital footprint alone, as seen below in the Google Search History since 2011, this is not the case for Fast & Furious Presents Hobbs & Shaw:

Consumer Engagement

Consumers are incredibly loyal to the Fast & Furious brand, but in the case of Hobbs & Shaw, they may be unaware that the movie exists or is related to the franchise. You need a fun way for them to be reminded of the franchise.

A Doppel Do Ya!

With the Doppel app, consumers instantly see their celebrity doppelgänger! The app can be customized to whatever domain of characters you desire. Universal Pictures has ordered the Fast & Furious Doppel to increase brand awareness and consumer engagement before the release of Hobbs & Shaw.

Data Understanding

Our app requires thousands of photographs of the characters' faces in order to produce a doppelgänger. For the demo, we downloaded these images ourselves through public searches. However, in typical deals, these assets will be provided to MLW Studios. The photos don't need to be a specific size, and the more photos the better. For movies, frame grabs would be helpful.

Data Preparation

First, we decided on the number of characters that we would include in our output options. We used focus groups to narrow down the long list to 18 beloved and well-known characters.

Next, we used the code at this GitHub repo to download hundreds of images per character.

We stored the images in an AWS s3 bucket, during which we learned a lot about the bucket policy requirements. We culled the images, making sure of their quality - removing any other characters in the photo.

Modeling

Using a convolutional neural network (MobileNet v2) that was pretrained for image feature extraction, we then created a random forest on those features to classify the input photos as one of the 18 characters.

#Evaluation Our model had 35% accuracy on our test data, which is about a 30% improvement over choosing a character randomly. We also included a car in our character output, to see if there were any egregious errors. By design, our product cannot be "wrong," but there a few ways we might improve the quality of the consumer experience:

  • We would train the model on more images.
  • We would crop the training images to only the character faces.
  • This is precisely the reason why in a typical sales cycle the purchasers will provide the images to us.
  • We would explore other models, given more time, especially other models pre-trained on facial feature recognition.
  • We would ask for more data so as not to overtrain our model and use cross validation.

Deployment

Doppel is deployable as an experiential in-person activation at an event, or it's available for placement on digital properties such as a mobile app or on a website. You can brand the output and allow for sharing on social media sites - when it comes to going viral, a Doppel do ya!

As an organization that believes in open source software, we also invite you to explore our product's GitHub repository! If you would like to run a version of the app on your local machine simply:

  • clone the repo to your local machine
  • pip install Flask (If not already installed)
  • From the project folder, in bash/terminal type:
    • FLASK_APP=app.py flask run

About

A face recognition app for fan engagement of the Hobbs & Shaw movie

http://www.doppeldoya.com


Languages

Language:JavaScript 56.2%Language:Jupyter Notebook 40.5%Language:CSS 2.5%Language:HTML 0.3%Language:Python 0.3%Language:PHP 0.1%