henryco / eox-capture

Real-time Stereo & Motion capture software

Deprecated, and got replaced by my other project ex-motion

Complex Real-time 3D Motion Capture tool (WIP)

How to clone properly

git clone \
    --recursive-submodules \
    [e-mail]:henryco/eox-capture.git

Dependencies

• OpenGL (Should be present by default)
• OpenCL (Should be present by default)
• OpenCV (tl;dr: libopencv-dev)
• GTKMM 4.0 (tl;dr: libgtkmm-4.0-dev)
• Spdlog (tl;dr: libspdlog-dev)
• V4l2 (tl;dr: libv4l-dev) (linux)
• TensorFlow (external/tensorflow)
• Argparse (external/argparse)
• Glm (external/glm)

TODO:

• Multi-camera setup (full 3D)
• Tensorflow blazepose model (body + face + hands landmarks)
• Region segmentation (humans only)
• API: Ableton/Max/PureData/Unity/UE

Cooking in progress

Body landmarks and pose detection (using blazepose tflite models)

Real-time 3D visualization (video)

Point cloud reconstruction, export to PLY (meshlab)

Disparity map + filtering