3D Object Reconstruction from
Hand-Object Interactions
General Info
The source code files in this directory are an implementation of the pipeline presented in the paper:
Tzionas D., Gall J.
3D Object Reconstruction from Hand-Object Interactions
International Conference on Computer Vision 2015 (ICCV'15)
http://files.is.tue.mpg.de/dtzionas/In-Hand-Scanning
Setup
The code was tested using Ubuntu 12.04, PCL 1.7, OpenCV 2.4.8.
Dependencies
CMake, OpenCV, Eigen3, libconfig++8-dev, Meshlab, QT4, PCL (also installes Boost):
sudo apt-get update
sudo apt-get install build-essential
sudo apt-get install libopencv-dev
sudo apt-get install libeigen3-dev
sudo apt-get install libconfig++8-dev
sudo apt-get install meshlab
sudo apt-get install qt4-dev-tools libqt4-dev libqt4-core libqt4-gui
sudo add-apt-repository ppa:v-launchpad-jochen-sprickerhof-de/pcl
sudo apt-get update
sudo apt-get install libpcl-all
CPU_TSDF
The source code is included in the directory
./3rd_party
Please refer to this location for the README.md and LICENSE files.
Compilation should be performed at this point as described in the README.md, followed by a:
sudo make install
Original source: https://github.com/sdmiller/cpu_tsdf
Build
mkdir build
cd build
cmake ..
make
Configure
Please download from the project's website
http://files.is.tue.mpg.de/dtzionas/In-Hand-Scanning/
- the Frames
(e.g. http://files.is.tue.mpg.de/dtzionas/In-Hand-Scanning/Dataset/Frames___All_Files___No_Detections/001.zip) - the Models/Motion/Camera
(e.g. http://files.is.tue.mpg.de/dtzionas/In-Hand-Scanning/Dataset/Models/SeqViewing/001.zip) file for each sequence (001 or 002 or 003 or 004).
Please:
- unzip them in a different location (to avoid name conflicts)
- do NOT change the name of the exported folder (should be 001 or 002 or 003 or 004)
- enter the names of directories where the zips were unzipped in the file ./config/CONFIG_PATHs.txt
Run
The paper includes the reconstruction of 4 objects (Water Bottle, Bowling Pin, Small Bottle, Sphere).
To run the reconstruction for an object run one of the following scripts from the current directory:
sh ./SCRIPT__1__WaterBottle.sh
sh ./SCRIPT__2__BowlingPin.sh
sh ./SCRIPT__3__SmallBottle.sh
sh ./SCRIPT__4__Sphere.sh