Daewon-Hwang / human-motion-capture

collect papers about human motion capture

Human Motion Capture

Collecting papers about human motion capture

⭐🔥💪 I will update each day and add more details about every paper ☀️☀️☀️

NOTE : Since motion capture is a field that has been studied for many years, I will collect the up to date papers first and then try to gather the old but classical one.

methods based directly on video

1. Physically Plausible Monocular 3D Motion Capture [project]
2. "Neural PhysCap" Neural Monocular 3D Human Motion Capture with Physical Awareness [project]
3. XNect: real-time multi-person 3D motion capture with a single RGB camera[project]
4. 4D Association Graph for Realtime Multi-person Motion Capture Using Multiple Video Cameras [code]
5. VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera [project]
6. TesseTrack: End-to-End Learnable Multi-Person Articulated 3D Pose Tracking [project]
7. Synergetic Reconstruction from 2D Pose and 3D Motion for Wide-Space Multi-Person Video Motion Capture in the Wild [project]
8. MonoPerfCap: Human Performance Capture from Monocular Video [project]
9. Capturing Detailed Deformations of Moving Human Bodies [project]
10. Lightweight Multi-person Total Motion Capture Using Sparse Multi-view Cameras [project]
11. Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videos [pdf]
12. Direct Multi-view Multi-person 3D Human Pose Estimation [code]
13. Human Performance Capture from Monocular Video in the Wild [pdf]
14. Camera Distortion-aware 3D Human Pose Estimation in Video with Optimization-based Meta-Learning[pdf] | [code]
15. Human Dynamics from Monocular Video with Dynamic Camera Movements [code] | [project]
16. AirPose: Multi-View Fusion Network for Aerial 3D Human Pose and Shape Estimation [code]
17. Neural MoCon: Neural Motion Control for Physically Plausible Human Motion Capture [project]
18. Permutation-Invariant Relational Network for Multi-person 3D Pose Estimation [pdf]
19. PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision [code]
20. Generalizable Human Pose Triangulation [code]
21. Differentiable Dynamics for Articulated 3d Human Motion Reconstruction [pdf]
22. VTP: Volumetric Transformer for Multi-view Multi-person 3D Pose Estimation [pdf]
23. Trajectory Optimization for Physics-Based Reconstruction of 3d Human Pose from Monocular Video [pdf]

methods based on body model such as smpl/smpl-x

Note that there are some papers that I don't list here most because I have tested it and the result is not so good(e,g. frankmocap,VIBE and so on)

1. Contact and Human Dynamics from Monocular Video [code]
2. DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Cameras [project]
3. Monocular, One-stage, Regression of Multiple 3D People [code]
4. BEV:Putting People in their Place,Monocular Regression of 3D People in Depth [project]
5. PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop [project]
6. End-to-End Human Pose and Mesh Reconstruction with Transformers [code]
7. Pose2Pose: 3D Positional Pose-Guided 3D Rotational Pose Prediction for Expressive 3D Human Pose and Mesh Estimation[paper] | [code]
8. AGORA: Avatars in Geography Optimized for Regression Analysis [code]
9. Real-time RGBD-based Extended Body Pose Estimation [code]
10. EasyMocap [code]
11. PanoMan: Sparse Localized Components–based Model for Full Human Motions [paper]
12. Monocular Total Capture: Posing Face, Body and Hands in the Wild [code]
13. Full-body motion capture for multiple closely interacting persons [paper]
14. PARE: Part Attention Regressor for 3D Human Body Estimation [project] | [code]
15. DSFN: Dynamic Surface Function Networks for Clothed Human Bodies [code]
16. 3D Human Pose and Shape Estimation Through Collaborative Learning and Multi-view Model-fitting [code]
17. On Self-Contact and Human Pose [project]
18. KAMA: 3D Keypoint Aware Body Mesh Articulation [paper] | [video]
19. Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstruction [code]
20. Multi-person Implicit Reconstruction from a Single Image [paper] | [video]
21. Body Meshes as Points [code]
22. Collaborative Regression of Expressive Bodies using Moderation [project]
23. Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images [paper]
24. RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream [paper]
25. Monocular Real-time Full Body Capture with Inter-part Correlations [project]
26. Learning Complex 3D Human Self-Contact [pdf]
27. Learning Local Recurrent Models for Human Mesh Recovery [pdf]
28. LASOR: Learning Accurate 3D Human Pose and Shape Via Synthetic Occlusion-Aware Data and Neural Mesh Rendering [pdf]
29. HuMoR: 3D Human Motion Model for Robust Pose Estimation [code]
30. Probabilistic Modeling for Human Mesh Recovery [code]
31. NeMF: Neural Motion Fields for Kinematic Animation [pdf]
32. Encoder-decoder with Multi-level Attention for 3D Human Shape and PoseEstimation [code]
33. LEMO: Learning Motion Priors for 4D Human Body Capture in 3D Scenes [ptoject]
34. Shape-aware Multi-Person Pose Estimation from Multi-View Images [project]
35. SPEC: Seeing People in the Wild with an Estimated Camera [project]
36. Learning to Regress Bodies from Images using Differentiable Semantic Rendering [code]
37. Mesh Graphormer [code]
38. VoteHMR: Occlusion-Aware Voting Network for Robust 3D Human Mesh Recovery from Partial Point Clouds [pdf] | [code]
39. Leveraging MoCap Data for Human Mesh Recovery [pdf]
40. PIXIE: Collaborative Regression of Expressive Bodies [code]
41. Dynamic Multi-Person Mesh Recovery From Uncalibrated Multi-View Cameras [pdf] }| [code]
42. Hierarchical Kinematic Probability Distributions for 3D Human Shape and Pose Estimation from Images in the Wild [code]
43. Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation [code]
44. Tracking People with 3D Representations [code]
45. LatentHuman: Shape-and-Pose Disentangled Latent Representation for for Human Bodies[project]
46. PoseBERT [project]
47. Camera Motion Agnostic 3D Human Pose Estimation [code]
48. GLAMR: Global Occlusion-Aware Human Mesh Recovery with Dynamic Cameras [project]
49. Revitalizing Optimization for 3D Human Pose and Shape Estimation: A Sparse Constrained Formulation [project]
50. ICON: Implicit Clothed humans Obtained from Normals [code]
51. Capturing Humans in Motion: Temporal-Attentive 3D Human Pose and Shape Estimation from Monocular Video [project]
52. Occluded Human Mesh Recovery [pdf]
53. Out-of-Domain Human Mesh Reconstruction via Dynamic Bilevel Online Adaptation [code]

human 3d pose estimation

1. Freemocap [code]
2. MeTRAbs: Metric-Scale Truncation-Robust Heatmaps for Absolute 3D Human Pose Estimation [code]
3. Part-aware Measurement for Robust Multi-View Multi-Human 3D Pose Estimation and Tracking [code]
4. Multi-View Multi-Person 3D Pose Estimation with Plane Sweep Stereo [code]
5. 3D Multi-Person Pose Estimation by Integrating Top-Down and Bottom-Up Networks [code]
6. CanonPose: Self-Supervised Monocular 3D Human Pose Estimation in the Wild [paper]
7. 3D Human Pose Estimation with Spatial and Temporal Transformers [code]
8. Weakly-Supervised 3D Human Pose Learning via Multi-view Images in the Wild [paper]
9. AdaFuse: Adaptive Multiview Fusion for Accurate Human Pose Estimation in the Wild [code]
10. Improving Robustness and Accuracy via Relative Information Encoding in 3D Human Pose Estimation [code]
11. Probabilistic-Monocular-3D-Human-Pose-Estimation-with-Normalizing-Flows [code]
12. VoxelTrack: Multi-Person 3D Human Pose Estimation and Tracking in the Wild [pdf]
13. MetaPose: Fast 3D Pose from Multiple Views without 3D Supervision [pdf]
14. CrossFormer: Cross Spatio-Temporal Transformer for 3D Human Pose Estimation[pdf]
15. Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation [project]
16. Ray3D: ray-based 3D human pose estimation for monocular absolute 3D localization [code]
17. PedRecNet: Multi-task deep neural network for full 3D human pose and orientation estimation [code]

simplify optical or inertial based motion capture

1. Real-Time Multi-person Motion Capture from Multi-view Video and IMUs[paper]
2. TransPose [code]
3. Physical Inertial Poser (PIP):Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors [project]
4. EM-POSE: 3D Human Pose Estimation from Sparse Electromagnetic Trackers [code]
5. HybridCap: Inertia-aid Monocular Capture of Challenging Human Motions [pdf]
6. Transformer Inertial Poser: Attention-based Real-time Human Motion Reconstruction from Sparse IMUs [pdf]
7. DeMoCap: Low-cost Marker-based Motion Capture [code]
8. LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensors [pdf]

human motion capture in 3d scene

1. 4D Human Body Capture from Egocentric Video via 3D Scene Grounding [project]
2. LEMO Learning Motion Priors for 4D Human Body Capture in 3D Scenes [project]
3. Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensors [project]
4. EgoBody Dataset:Human Body Shape, Motion and Social Interactions from Head-Mounted Devices[project]
5. GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping [project]
6. HSC4D: Human-centered 4D Scene Capture in Large-scale Indoor-outdoor Space Using Wearable IMUs and LiDAR [project]
7. Human-Aware Object Placement for Visual Environment Reconstruction [project]
8. COAP: Compositional Articulated Occupancy of People [project]
9. BEHAVE: Dataset and Method for Tracking Human Object Interactions [project]
10. Synthesizing Long-Term 3D Human Motion and Interaction in 3D [project]
11. Visually plausible human-object interaction capture from wearable sensors [project]
12. HULC: 3D HUman Motion Capture with Pose Manifold Sampling and Dense Contact Guidance [project]
13. Towards Diverse and Natural Scene-aware 3D Human Motion Synthesis [pdf]