Project build log: https://hackaday.io/project/167713
#Python programs
This is the main program, with object detection. It can detect and distinguishes objects. It contains a TCP server. When client connected this will post a JSON array to a client. The array contains, camera ID, detected object name, x, y coordinates, and Z for the depth (distance to the detected object) When we are testing it we used with multiple instances with different camera ID, because we don't need frame synced operation.
This is used to exporting images with various colormaps for testing
This is the TCP server to test the depth map visualisation in unreal engine
For host testing. Simple echo server
Simple client for sending one message, and receive response
Continous listening for messages from the server.
For joystick control for example: logitech Extreme 3D Pro
For xbox 360 controller
Main python program running on the robot. The head, and stepper motor controller
- This requires adafruit-circuitpython-servokit
- run on rpi:
python -m pip install -r requirements_v2.txt python -m pip install -r requirements_rpi.txt
Test program for only to move the robot
- it can be used to test the communication on windows
-
create virtualenv enviroment
-
Install requirements
python -m pip install -r requirements.txt
from this guide: https://www.waveshare.com/wiki/Servo_Driver_HAT
- Enable I2C Interface
sudo raspi-config
Choose Interfacing Options -> I2C ->yes
sudo reboot
- Install libraries
python -m pip install -r requirements_rpi.txt
It contains the model for the main.py (object detection)