notify7go / deepsketch2face

Demo and Database of "DeepSketch2Face" in SIGGRAPH 2017

DeepSketch2Face

Note: The Source Code and Database will be uploded in the near future. Please keep staring if you need them.

Demo of DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modeling. We use Caffe modified from Microsoft/Caffe. Default Development OS is Windows 10 x64.

Demo (Pure Alexnet Version)

0. Download repo here
1. Download caffemodel and dlls and expand to $(this_repo)\demo
2. Install CUDA v8.0 (into C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.0) and cudnn v5.1 (copy files into C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.0\cuda). Other Versions are not supported.
3. Run $(this_repo)\demo\deepsketch2face.exe

Known Bugs:

1. Moving the program window may cause shift in transparent drawing window. We advice you not to move the program window.
2. Run $(this_repo)\demo\deepsketch2face_shift.exe if the projection of you mouse in refinement mode is not correct.

Source Code Reproduction (Comming in the near future)

0. Download source repo here
1. Install Visual Studio 2013 Ultimate
2. Install CUDA v8.0 (into C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.0) and cudnn v5.1 (copy files into C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.0\cuda). Other Versions are not supported.
3. Build $(this_repo)\tools\caffe-master\windows\Caffe.sln in Release x64. If there are errors, check if step 2 is correctly done.
4. Install Qt 5.8 (VS2013 x64). Other Versions are not supported.
5. If you use different Qt and Visual Studio version, you need to rebuild $(this_repo)\tools\libQGLViewer\QGLViewer in Qt Creator.
6. In $(this_repo)\tools\caffe-master\include\caffe\proto\caffe.pb.h, change "STRICT" in line 2525 and 9794 into "_STRICT"
7. Open $(this_repo)\src\deepsketch2face.pro in Qt Creator, set build directory to $(this_repo)\build, then build the program in Release.
8. Copy $(this_repo)\build\release\deepsketch2face.exe into $(this_repo)\demo
9. For all .dll file in $(this_repo)\demo and $(this_repo)\demo\platforms, if you build the program in different settings, you may need to change them correspondingly. A safe but redundant move is to copy all .dll file in $(this_repo)\tools\ and Qt here.
10. Run $(this_repo)\demo\deepsketch2face.exe

Known Bugs:

1. Moving the program window may cause shift in transparent drawing window. We advice you not to move the program window.
2. If the projection of you mouse in refinement mode is not correct, you may change viewControl->move(x, y); at around line 137 in Mainwindow.cpp

Database (Comming in the near future)