mkarroqe / dancing-screen

Senior Design Project: Teaching AI to dance through Fortnite Videos.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

The Dancing Screen

Presenting my Senior Design Project: Teaching an AI to dance through Fortnite videos. All work is being done through Google Colab notebooks. Most recent work in this folder.

Input Data

My training data is extracted from this 51:52 minute complilation video of 146 Fornite dances. I am extracting one frame every 2 seconds for a total of 186,720 images.

Frame Extraction Pipeline

Before my frames are fed through my model, they are converted into binary images:

Before After
original image binary converted image
Step Result
1 Increase contrast to reduce background gradient to blue and cyan pixels contrast image
2 Remove blue and cyan pixels and replace them with white. blue and cyan free image
3 Remove remaining intermediary blue hues and replace them with white pixels. With the background isolated, all other pixels are converted to orange. final image
4 Finally, the image is cropped to remove the sidebars. cropped

About

Senior Design Project: Teaching AI to dance through Fortnite Videos.


Languages

Language:Jupyter Notebook 100.0%