Digital Human's repositories
FaceVerse-Dataset
High-quality 3D head model dataset.
MocapNET
We present MocapNET, a real-time method that estimates the 3D human pose directly in the popular Bio Vision Hierarchy (BVH) format, given estimations of the 2D body joints originating from monocular color images. Our contributions include: (a) A novel and compact 2D pose NSRM representation. (b) A human body orientation classifier and an ensemble of orientation-tuned neural networks that regress the 3D human pose by also allowing for the decomposition of the body to an upper and lower kinematic hierarchy. This permits the recovery of the human pose even in the case of significant occlusions. (c) An efficient Inverse Kinematics solver that refines the neural-network-based solution providing 3D human pose estimations that are consistent with the limb sizes of a target person (if known). All the above yield a 33% accuracy improvement on the Human 3.6 Million (H3.6M) dataset compared to the baseline method (MocapNET) while maintaining real-time performance
Time-Travel-Rephotography.github.io
We simulate traveling back in time with a modern camera to rephotograph famous historical subjects.
awesome-hand-pose-estimation
Awesome work on hand pose estimation/tracking
Awesome-Image-Matting
:notebook: A curated list of deep learning image matting papers and codes
CodeFormer
[NeurIPS 2022] Towards Robust Blind Face Restoration with Codebook Lookup Transformer
Deep3DFaceRecon_pytorch
Accurate 3D Face Reconstruction with Weakly-Supervised Learning: From Single Image to Image Set (CVPRW 2019). A PyTorch implementation.
DiffSinger
DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code
facescape
FaceScape: a Large-scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction (CVPR2020)
headnerf
This repository contains a pytorch implementation of "HeadNeRF: A Real-time NeRF-based Parametric Head Model (CVPR 2022)".
humannerf
HumanNeRF turns a monocular video of moving people into a 360 free-viewpoint video.
large-steps-pytorch
Implementation of "Large Steps in Inverse Rendering of Geometry"
mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
MICA
MICA - Towards Metrical Reconstruction of Human Faces (ECCV 2022)
MMEmotionRecognition
Repository with the code of the paper: A proposal for Multimodal Emotion Recognition using auraltransformers and Action Units on RAVDESS dataset
Multi-Singer
PyTorch Implementation of Multi-Singer (ACM-MM'21)
muzic
Muzic: Music Understanding and Generation with Artificial Intelligence
NDR-code
[NeurIPS 2022] Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Camera
NeuralSVB
Learning the Beauty in Songs: Neural Singing Voice Beautifier; ACL 2022 (Main conference); Official code
NeuS
Code release for NeuS
NextFace
A high-fidelity 3D face reconstruction library from monocular RGB image(s)
noah-research
Noah Research
PPM
A High-Quality Photograpy Portrait Matting Benchmark