A drone project that performs object detection and make a search engine out of the drone feed. Project under Machine Learning and AI society of Developer Students Club - IIT Patna.
Modern drones are be equipped with cameras and are very prospective for a variety of commercial uses such as aerial photography, surveillance, etc.n. However, there are more challenges with drones due to top-down view angles and real-time constraints. Additionally, a challenging problem is the strong weight and area constraint of embedded hardware that limits the drones to run computation intensive algorithms, such as deep learning, with limited hardware resource.
Drone-Eye is a framework that intends to tackle both problems while running on embedded systems that can be mounted onto drones.Deep neural networks, object detection and object searching are the three major components in our work.
- Basic Deep Learning concepts.
- Basics of Convolutional Neural Networks.
- Object Detection using CNN
- Tools
- Pytorch
- Tensorflow
- Keras
- Basic python libraries used in ML (Scikit-learn, Pandas, Matplotlib).
- Drone hexacopter or octacopter
- PixHawk
- PPM Encoder
- Propellers
- 6-8 Brushless Motors
- 6-8 Electronic Speed Controllers
- Landing Gear
- Radio remote
- NVIDIA Jetson Nano
- Camera (USB Cam will do)
- Gimble
- Making/Getting a drone.
- Putting on camera.
- Computation board like Jetson.
- Apply YOLO and other models on the feed of the camera
- Use object detection with web cam
- Find how to do the same task on NVIDIA Jetson Nano
- Config and Implement the processing on Jetson board with external camera
- Deploy the setup on the drone
- Get the relevant info from the drone
- Tag the detected objects with GPS location, Compass direction and Time stamp.
- Send these info on a server.
- Make a search engine on the detected objects.
http://www.deeplearningbook.org/
Further we may deploy the model on a swarm of drones so that objects detected are not redundant.
Our chat channel is to be found on Discord here.
- Sahil Aggarwal (Project Lead)
- Piyush Chauhan(Project Lead)
- Sriram Pingali
- Nischal A