Eric Wang's repositories
clip-glass
Repository for "Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search"
CoverSystem
Real-Time Dynamic Cover System for Unreal Engine 4
ericwang0701.github.io
New personal website
face-alignment
:fire: 2D and 3D Face alignment library build using pytorch
FaceMeshBarracuda
MediaPipe Face Mesh (facial landmark detector) for Unity Barracuda
fairmotion
Tools to load, process and visualize motion capture data
GAST-Net-3DPoseEstimation
A Graph Attention Spatio-temporal Convolutional Networks for 3D Human Pose Estimation in Video (GAST-Net)
heroku-flask-api
Deploy an API built with Flask on Heroku, in order to match game banners.
ManualNavMesh
Sample Unreal Engine project for creating Detour NavMeshes manually
MocapNET
We present MocapNET2, a real-time method that estimates the 3D human pose directly in the popular Bio Vision Hierarchy (BVH) format, given estimations of the 2D body joints originating from monocular color images. Our contributions include: (a) A novel and compact 2D pose NSRM representation. (b) A human body orientation classifier and an ensemble of orientation-tuned neural networks that regress the 3D human pose by also allowing for the decomposition of the body to an upper and lower kinematic hierarchy. This permits the recovery of the human pose even in the case of significant occlusions. (c) An efficient Inverse Kinematics solver that refines the neural-network-based solution providing 3D human pose estimations that are consistent with the limb sizes of a target person (if known). All the above yield a 33% accuracy improvement on the Human 3.6 Million (H3.6M) dataset compared to the baseline method (MocapNET) while maintaining real-time performance (70 fps in CPU-only execution).
natural-language-youtube-search
Search inside YouTube videos using natural language
neural-blend-shapes
An end-to-end library for automatic character rigging, skinning, and blend shapes generation, as well as a visualization tool [SIGGRAPH 2021]
Neural-Re-Rendering-of-Humans-from-a-Single-Image
Pytorch implementation of the paper, Neural re-rendering of humans from a single image.
neural-textures
Inference code for "StylePeople: A Generative Model of Fullbody Human Avatars" paper. This code is for the part of the paper describing video-based avatars.
neuralbody
Code for "Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans" CVPR 2021
NeuralRecon
Code for "NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Video", CVPR 2021 oral
recastnavigation
Navigation-mesh Toolset for Games
rgbd-kinect-pose
Demo for Real-time RGBD-based Extended Body Pose Estimation paper
style-people
Inference code for "StylePeople: A Generative Model of Fullbody Human Avatars" paper
vision-based-prediction
Deep Learning for Vision-based Prediction