Rocksus / EMG-DroneControl

A project made to complete my undergraduate studies in computer engineering.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

EMG RNN CNN Gesture Recognition

This is a project that I made to complete my undergraduate studies in computer engineering. I used muscle contraction data (EMG) as inputs for a CNN RNN hybrid neural network. I also provided several other models located in the Models folder.

Overview

Model is trained using 8 EMG points, here's an example of a gesture data:

image

Data was then processed into a several Neural Network Model with different configurations. Working model was then tested using a real drone / simulated environment.

image image

Model Results

Training results from each model can be seen in the Results folder.

Requirements

  • Python 3.5 or more
  • Keras
  • Myo
  • Dronekit
  • Dronekit-SITL
  • Pymavlink
  • Pymavproxy
  • Mission Planner

Setup

  1. Install the required libraries in Python
     pip install dronekit
     pip install dronekit-sitl
     pip install Keras
     pip install myo-python
    
  2. Download the Myo SDK and edit the sdk_path accordingly.
  3. Test the connection to your drone using DroneControl/connect_check.py
  4. If everything is fine and well you are good to go!

Usage

Run

emg_control.py

Located in the DroneControl folder. Note: Please edit the velocity of your drone accordingly inside the code.

About

A project made to complete my undergraduate studies in computer engineering.


Languages

Language:HTML 74.9%Language:JavaScript 9.4%Language:C++ 5.6%Language:Python 5.2%Language:CSS 3.1%Language:C 1.8%