Awesome Works on Hand Pose Estimation
Table of Contents
Evaluation codes
See folder evaluation
to get more details about performance evaluation for hand pose estimation.
arXiv Papers
[arXiv:1708.03416] Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation. [PDF]
Xinghao Chen, Guijin Wang, Hengkai Guo, Cairong Zhang
[arXiv:1707.07248] Towards Good Practices for Deep 3D Hand Pose Estimation. [PDF] [Code]
Hengkai Guo, Guijin Wang, Xinghao Chen, Cairong Zhang
[arXiv:1707.03742] Large-scale Multiview 3D Hand Pose Dataset. [PDF]
Francisco Gomez-Donoso, Sergio Orts-Escolano and Miguel Cazorla
[arXiv:1705.09606] End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth data. [PDF]
Meysam Madadi, Sergio Escalera, Xavier Baro, Jordi Gonzalez
[arXiv:1704.02224] Hand3D: Hand Pose Estimation using 3D Neural Network. [PDF] [Project Page]
Xiaoming Deng*, Shuo Yang*, Yinda Zhang*, Ping Tan, Liang Chang, Hongan Wang
[arXiv:1612.00596] Learning to Search on Manifolds for 3D Pose Estimation of Articulated Objects. [PDF]
Yu Zhang, Chi Xu, Li Cheng
[arXiv:1610.07214] 3D Hand Pose Tracking and Estimation Using Stereo Matching. [PDF]
Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, Qingxiong Yang
Conference Papers
2017 ICCV
[PDF] [Project Page] [Code]
Learning to Estimate 3D Hand Pose from Single RGB Images.Christian Zimmermann, Thomas Brox
[PDF] [Project Page]
Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor.Franziska Mueller, Dushyant Mehta, Oleksandr Sotnychenko, Srinath Sridhar, Dan Casas, Christian Theobalt
[PDF] [Supp] [Project Page]
Robust Hand Pose Estimation during the Interaction with an Unknown Object.Chiho Choi, Sang Ho Yoon, Chin-Ning Chen, Karthik Ramani
[PDF] [Supp] [Project Page]
Learning Hand Articulations by Hallucinating Heat Distribution.Chiho Choi, Sangpil Kim, Karthik Ramani
[PDF]
[Hands17 Workshop] Back to RGB: 3D tracking of hands and hand-object interactions based on short-baseline stereo.Paschalis Panteleris, Antonis Argyros
[PDF] [Project Page] [Code]
[Hands17 Workshop] DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation.Markus Oberweger and Vincent Lepetit
[PDF]
[Hands17 Workshop] Hand Pose Estimation Using Deep Stereovision and Markov-chain Monte Carlo.Rilwan Remilekun Basaru, Chris Child, Eduardo Alonso, Greg Slabaugh
2017 CVPR
[PDF] [Project Page] [Code]
Hand Keypoint Detection in Single Images using Multiview Bootstrapping.Tomas Simon, Hanbyul Joo, Iain Matthews, Yaser Sheikh
[PDF]
Crossing Nets: Combining GANs and VAEs with a Shared Latent Space for Hand Pose Estimation.Chengde Wan, Thomas Probst, Luc Van Gool, Angela Yao
[PDF]
Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis.Shanxin Yuan*, Qi Ye*, Bjorn Stenger, Siddhand Jain, Tae-Kyun Kim
[PDF] [Project Page]
3D Convolutional Neural Networks for Efficient and Robust Hand Pose Estimation from Single Depth Images.Liuhao Ge, Hui Liang, Junsong Yuan and Daniel Thalmann
2017 Others
[PDF] [Code]
[2017 ICIP] Region Ensemble Network: Improving Convolutional Network for Hand Pose Estimation.Hengkai Guo, Guijin Wang, Xinghao Chen, Cairong Zhang, Fei Qiao, Huazhong Yang
[PDF] [Project Page]
[2017 ICIP] A Hand Pose Tracking Benchmark from Stereo Matching.Jiawei Zhang, Jianbo Jiao, Mingliang Chen, Liangqiong Qu, Xiaobin Xu, and Qingxiong Yang
[PDF] [Project Page]
[2017 SIGGRAPH Asia] Online Generative Model Personalization for Hand Tracking.Anastasia Tkach*, Andrea Tagliasacchi*, Edoardo Remelli, Mark Pauly, Andrew Fitzgibbon
[PDF] [Project Page]
[2017 SIGGRAPH Asia] Embodied Hands: Modeling and Capturing Hands and Bodies Together.Javier Romero*, Dimitrios Tzionas* and Michael J. Black
[PDF]
[2017 BMVC] Hand Pose Learning: Combining Deep Learning and Hierarchical Refinement for 3D Hand Pose Estimation.Min-Yu Wu, Ya Hui Tang, Pai-Wei Ting and Li-Chen Fu
[PDF] [Project Page]
[2017 BMVC] Generative 3D Hand Tracking with Spatially Constrained Pose Sampling.Konstantinos Roditakis, Alexandros Makris and Antonis Argyros
[PDF]
[2017 ICRA] Learning a deep network with spherical part model for 3D hand pose estimation.Tzu-Yang Chen, Pai-Wen Ting, Min-Yu Wu, Li-Chen Fu
[PDF] [Slide]
[2017 FG] Occlusion aware hand pose recovery from sequences of depth images.Meysam Madadi, Sergio Escalera, Alex Carruesco Llorens, Carlos Andujar, Xavier Baro, Jordi Gonzalez
[PDF] [Project Page]
[2017 FG] 3D Hand-Object Pose Estimation from Depth with Convolutional Neural Networks.Duncan Goudie, Aphrodite Galata
2016 ECCV
[PDF] [Project Page]
Spatial Attention Deep Net with Partial PSO for Hierarchical Hybrid Hand Pose Estimation.Qi Ye*, Shanxin Yuan*, Tae-Kyun Kim
[PDF]
Hand Pose Estimation from Local Surface Normals.Chengde Wan, Angela Yao, and Luc Van Gool
[PDF] [Project Page]
Real-time Joint Tracking of a Hand Manipulating an Object from RGB-D Input.Srinath Sridhar, Franziska Mueller, Michael Zollhöfer, Dan Casas, Antti Oulasvirta, Christian Theobalt
2016 Others
[PDF]
[2016 ICPR] Depth-based 3D hand pose tracking.Kha Gia Quach, Chi Nhan Duong, Khoa Luu, and Tien D. Bui.
[PDF] [Project Page] [Code]
[2016 IJCAI] Model-based Deep Hand Pose Estimation.Xingyi Zhou, Qingfu Wan, Wei Zhang, Xiangyang Xue, Yichen Wei
[PDF]
[2016 SIGGRAPH] Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences.Jonathan Taylor et al.
[PDF] [Project Page] [Code]
[2016 SIGGRAPH Asia] Sphere-Meshes for Real-Time Hand Modeling and Tracking.Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi
2016 CVPR
[PDF] [Project Page] [Code]
Robust 3D Hand Pose Estimation in Single Depth Images: From Single-View CNN to Multi-View CNNs.Liuhao Ge, Hui Liang, Junsong Yuan, Daniel Thalmann
[PDF][Project Page]
DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed With Deep Features.Ayan Sinha*, Chiho Choi*, Karthik Ramani
[PDF] [Project Page] [Code]
Efficiently Creating 3D Training Data for Fine Hand Pose Estimation.Markus Oberweger, Gernot Riegler, Paul Wohlhart, Vincent Lepetit
[PDF] [Project Page]
Fits Like a Glove: Rapid and Reliable Hand Shape Personalization.David Joseph Tan, Thomas Cashman, Jonathan Taylor, Andrew Fitzgibbon, Daniel Tarlow, Sameh Khamis, Shahram Izadi, Jamie Shotton
2015 ICCV
[PDF] [Project Page]
Training a Feedback Loop for Hand Pose Estimation.Markus Oberweger, Paul Wohlhart, Vincent Lepetit
[PDF]
Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose.Danhang Tang, Jonathan Taylor, Pushmeet Kohli, Cem Keskin, Tae-Kyun Kim, Jamie Shotton
[PDF] [Project Page] [Code]
Depth-based hand pose estimation: data, methods, and challenges.James Supancic III, Deva Ramanan, Gregory Rogez, Yi Yang, Jamie Shotton
[PDF]
3D Hand Pose Estimation Using Randomized Decision Forest with Segmentation Index Points.Peiyi Li, Haibin Ling
[PDF] [Project Page]
A collaborative filtering approach to real-time hand pose estimation.Chiho Choi, Ayan Sinha, Joon Hee Choi, Sujin Jang, Karthik Ramani
[PDF]
Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions.Sven Bambach, Stefan Lee, David Crandall, Chen Yu
[PDF]
Understanding Everyday Hands in Action from RGB-D Images.Gregory Rogez, James Supancic III, Deva Ramanan
2015 CVPR
[PDF]
Cascaded Hand Pose Regression.Xiao Sun, Yichen Wei, Shuang Liang, Xiaoou Tang, and Jian Sun
[PDF] [Project Page]
Fast and Robust Hand Tracking Using Detection-Guided Optimization.Srinath Sridhar, Franziska Mueller, Antti Oulasvirta, Christian Theobalt
[PDF]
Learning an Efficient Model of Hand Shape Variation from Depth Images.Sameh Khamis, Jonathan Taylor, Jamie Shotton, Cem Keskin, Shahram Izadi, Andrew Fitzgibbon
2015 Others
[PDF] [Project Page]
[2015 CHI] Accurate, Robust, and Flexible Real-time Hand Tracking.Toby Sharp, Cem Keskin, Duncan Robertson, Jonathan Taylor, Jamie Shotton, David Kim, Christoph Rhemann, Ido Leichter, Alon Vinnikov, Yichen Wei, Daniel Freedman, Pushmeet Kohli, Eyal Krupka, Andrew Fitzgibbon, Shahram Izadi
[PDF] [Project Page] [Code]
[2015 CVWW]Hands Deep in Deep Learning for Hand Pose Estimation.Markus Oberweger, Paul Wohlhart, Vincent Lepetit
[PDF] [Project Page]
[2015 FG]Combining Discriminative and Model Based Approaches for Hand Pose Estimation.Philip Krejov, Andrew Gilbert, Richard Bowden
[PDF] [Project Page] [Code]
[2015 SGP] Robust Articulated-ICP for Real-Time Hand Tracking.Anastasia Tkach, Mark Pauly, Andrea Tagliasacchi
2014 CVPR
[PDF] [Project Page]
Realtime and robust hand tracking from depth.Chen Qian, Xiao Sun, Yichen Wei, Xiaoou Tang and Jian Sun
[PDF] [Project Page]
Latent regression forest: Structured estimation of 3d articulated hand posture.Danhang Tang, Hyung Jin Chang, Alykhan Tejani, T-K. Kim
[PDF] [Project Page]
User-specific hand modeling from monocular depth sequences.Jonathan Taylor, Richard Stebbing, Varun Ramakrishna, Cem Keskin, Jamie Shotton, Shahram Izadi, Aaron Hertzmann, Andrew Fitzgibbon
[PDF] [Project Page]
Evolutionary Quasi-random Search for Hand Articulations Tracking.Iason Oikonomidis, Manolis IA Lourakis, Antonis A Argyros
2014 Others & Before
[PDF] [Project Page]
[2014 SIGGRAPH] Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks.Jonathan Tompson, Murphy Stein, Yann Lecun and Ken Perlin
[PDF] [Project Page]
[2013 ICCV] Real-time Articulated Hand Pose Estimation using Semi-supervised Transductive Regression Forests.Danhang Tang, Tsz Ho Yu and T-K. Kim
[PDF] [Project Page]
[2013 ICCV] Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data.Srinath Sridhar, Antti Oulasvirta, Christian Theobalt
[PDF] [Project Page]
[2013 ICCV] Efficient Hand Pose Estimation from a Single Depth Image.Chi Xu, Li Cheng
[PDF] [Project Page]
[2012 ECCV] Motion Capture of Hands in Action using Discriminative Salient Points.Ballan, L. and Taneja, A. and Gall, J. and van Gool, L. and Pollefeys, M.
[2012 ECCV] Hand pose estimation and hand shape classification using multi-layered randomized decision forests.
Cem KeskinFurkan, KıraçYunus Emre, KaraLale Akarun
[PDF]
[2011 CVPRW] Real Time Hand Pose Estimation using Depth Sensors.Cem Keskin, Furkan Kırac, Yunus Emre Kara, Lale Akarun
[PDF] [Project Page] [Code]
[2011 BMVC] Efficient Model-based 3D Tracking of Hand Articulations using Kinect.Iason Oikonomidis, Nikolaos Kyriazis, Antonis A. Argyros
Journal Papers
[PDF]
[2017 CVIU] Hand Pose Estimation through Semi-Supervised and Weakly-Supervised Learning.Natalia Neverova, Christian Wolf, Florian Nebout, Graham Taylor
[PDF] [Project Page]
[2016 IJCV] Capturing Hands in Action using Discriminative Salient Points and Physics Simulation.Tzionas, D., Ballan, L., Srikantha, A., Aponte, P., Pollefeys, M., Gall, J.
[PDF] [Project Page]
[2016 IJCV] Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups.Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, Li Cheng
[2016 TPAMI] Latent Regression Forest: Structured Estimation of 3D Hand Poses.
Danhang Tang, Hyung Chang, Alykhan Tejani, Tae-Kyun Kim
[PDF] [Project Page]
[2016 CVIU] Guided Optimisation through Classification and Regression for Hand Pose Estimation.Philip Krejov, Andrew Gilbert, Richard Bowden
[PDF]
[2015 TCSVT] Resolving Ambiguous Hand Pose Predictions by Exploiting Part Correlations.Hui Liang, Junsong Yuan, Daniel Thalmann
[PDF] [Project Page] [Code]
[2015 IJCV] Estimate Hand Poses Efficiently from Single Depth Images.Chi Xu, Ashwin Nanjappa, Xiaowei Zhang, Li Cheng
[PDF] [Project Page] [Code]
[2014 TMM] Parsing the Hand in Depth Images.Hui Liang, Junsong Yuan, Daniel Thalmann
Theses
[PDF] [Project Page]
[2017 Thesis] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects.Dimitrios Tzionas, University of Bonn
[PDF]
[2016 Thesis] Tracking Hands in Action for Gesture-based Computer Input.Srinath Sridhar, Max Planck Institute for Informatics
[PDF] [Project Page]
[2016 Thesis] 3D hand pose regression with variants of decision forests.Danhang Tang, Imperial College London
[PDF] [Project Page]
[2016 Thesis] Deep Learning for Human Motion Analysis.Natalia Neverova, National Institut of Applied Science (INSA de Lyon), France
[PDF] [Project Page]
[2016 Thesis] Real time hand pose estimation for human computer interaction.Philip Krejov, University of Surrey
[PDF]
[2015 Thesis] Efficient Tracking of the 3D Articulated Motion of Human Hands.Iason Oikonomidis, University of Crete
[PDF]
[2015 Thesis] Vision-based hand pose estimation and gesture recognition.Hui Liang, Nanyang Technological University
[PDF]
[2015 Thesis] Localization of Humans in Images Using Convolutional Networks.Jonathan Tompson, New York University
Datasets
NYU Hand Pose Dataset
- Website
- Related Paper: Real-Time Continuous Pose Recovery of Human Hands Using Convolutional Networks, SIGGRAPH 2014 [PDF]
ICVL Dataset
- Website
- Related Paper: Latent regression forest: Structured estimation of 3d articulated hand posture, CVPR 2014 [PDF]
MARA15 Dataset
- Website
- Related Paper: Cascaded Hand Pose Regression, CVPR 2015 [PDF]
BigHand2.2M Benchmark
- Website
- Related Paper: Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, CVPR 2017 [PDF]
MARC (FingerPaint) Dataset
- Website
- Related Paper: Accurate, Robust, and Flexible Real-time Hand Tracking, CHI 2015 [PDF]
UCI-EGO Dataset
- Website
- Related Paper: 3D Hand Pose Detection in Egocentric RGB-D Images, ECCVW 2014 [PDF]
Hands in Action Dataset
- Website
- Related Paper: Capturing Hands in Action using Discriminative Salient Points and Physics Simulation, IJCV 2016 [PDF]
MARA14 Dataset
- Website
- Related Paper: Realtime and Robust Hand Tracking from Depth, CVPR 2014 [PDF]
Dexter 1 Dataset
- Website
- Related Paper: Interactive Markerless Articulated Hand Motion Tracking Using RGB and Depth Data, ICCV 2013 [PDF]
ASTAR Dataset
- Website
- Related Paper: Efficient hand pose estimation from a single depth image, ICCV 2013 [PDF]
Credits:
- [1] Big Hand 2.2M Benchmark: Hand Pose Data Set and State of the Art Analysis, CVPR 2017 [PDF]
- [2] http://arrummzen.net/#HandData
- [3] Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects. [PDF]
Challenges
The 2017 Hands in the Million Challenge on 3D Hand Pose Estimation.
3rd International Workshop on Observing and Understanding Hands in Action ( HANDS 2017), ICCV 2017
- Challenge Website
- Submission Website: Frame and Tracking Task, Hand-Object Task
- Document: The 2017 Hands in the Million Challenge on 3D Hand Pose Estimation, arXiv:1704.02463, Shanxin Yuan, Qi Ye, Guillermo Garcia-Hernando, Tae-Kyun Kim
Other Related Papers
[PDF] [Project Page] [Code]
[2017 ICCV] Low-Dimensionality Calibration through Local Anisotropic Scaling for Robust Hand Model Personalization.Edoardo Remelli*, Anastasia Tkach*, Andrea Tagliasacchi, Mark Pauly
[2017 Neurocomputing] Multi-task, Multi-domain Learning: application to semantic segmentation and pose regression.
Fourure, Damien, et al.
[arXiv:1704.02463] First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations. [PDF]
Guillermo Garcia-Hernando, Shanxin Yuan, Seungryul Baek, Tae-Kyun Kim
[PDF]
[2017 CVPR] SurfNet: Generating 3D shape surfaces using deep residual networks.Ayan Sinha, Asim Unmesh, Qixing Huang, Karthik Ramani
[PDF] [Project Page] [Code-Tensorflow] [Code-Keras] [Code-Tensorflow-NYU-Hand]
[2017 CVPR] Learning from Simulated and Unsupervised Images through Adversarial Training.Ashish Shrivastava, Tomas Pfister, Oncel Tuzel, Josh Susskind, Wenda Wang, Russ Webb
[PDF] [Project Page]
[2016 3DV] Learning to Navigate the Energy Landscape.Julien Valentin, Angela Dai, Matthias Niessner, Pushmeet Kohli, Philip H.S. Torr, Shahram Izadi
[PDF] [Project Page] [Code]
[2016 NIPS] DISCO Nets : Dissimilarity Coefficient Networks.Diane Bouchacourt, M. Pawan Kumar, Sebastian Nowozin
[PDF] [Project Page]
[2015 ICCV] 3D Object Reconstruction from Hand-Object Interactions.Dimitrios Tzionas and Juergen Gall
* indicates equal contribution