Junxuan Bai's repositories
2D-Motion-Retargeting
PyTorch implementation for our paper Learning Character-Agnostic Motion for Motion Retargeting in 2D, SIGGRAPH 2019
3dmm_cnn
Regressing Robust and Discriminative 3D Morphable Models with a very Deep Neural Network
AI4Animation
Character Animation in Unity3D using Deep Learning and Artificial Intelligence
anim_utils
Data structures and utilities for skeleton animations.
bvh-python
Python module for parsing BVH (Biovision hierarchical data) mocap files
CPP-Fluid-Particles
my own implementation of the WCSPH, DFSPH and PBD fluid solvers using CUDA and C++
eccv18_mtvae
Tensorflow Implementation of ECCV'18 paper: Multimodal Human Motion Synthesis
faceswap
Non official project based on original /r/Deepfakes thread. Many thanks to him!
FAST
Fast Automatic Skinning Transformations
FlowerFactory
Flower Factory: A Component-based Approach for Rapid Flower Modeling
footskate_reducer
[WACV 2020] Reducing Footskate in Human Motion Reconstruction with Ground Contact Constraints
instant-meshes
Interactive field-aligned mesh generator
JunxuanBai.github.io
Homepage
mklaren
A Python Multiple kernel learning library.
MocapNET
We present MocapNET2, a real-time method that estimates the 3D human pose directly in the popular Bio Vision Hierarchy (BVH) format, given estimations of the 2D body joints originating from monocular color images. Our contributions include: (a) A novel and compact 2D pose NSRM representation. (b) A human body orientation classifier and an ensemble of orientation-tuned neural networks that regress the 3D human pose by also allowing for the decomposition of the body to an upper and lower kinematic hierarchy. This permits the recovery of the human pose even in the case of significant occlusions. (c) An efficient Inverse Kinematics solver that refines the neural-network-based solution providing 3D human pose estimations that are consistent with the limb sizes of a target person (if known). All the above yield a 33% accuracy improvement on the Human 3.6 Million (H3.6M) dataset compared to the baseline method (MocapNET) while maintaining real-time performance (70 fps in CPU-only execution).
openpose
OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
pix2face
3D human face estimation and rendering from a single image
PositionBasedDynamics
PositionBasedDynamics is a library for the physically-based simulation of rigid bodies, deformable solids and fluids.
Test
Personal website
video_to_bvh
Convert human motion from video to .bvh
VideoTo3dPoseAndBvh
Convert video to the bvh motion file