Abstract:Using video sequences to restore 3D human poses is of great significance in the field of motion capture. This paper proposes a novel approach to estimate 3D human action via end-to-end learning of deep convolutional neural network to calculate the parameters of the parameterized skinned multi-person linear model. The method is divided into two main stages: (1) 3D human pose estimation based on a single frame image. We use 2D/3D skeleton point constraints, human height constraints, and generative adversarial network constraints to obtain a more accurate human-body model. The model is pre-trained using open-source human pose datasets; (2) Human-body pose generation based on video streams. Combined with the correlation of video sequences, a 3D human pose recovery method based on video streams is proposed, which uses the correlation between videos to generate a smoother 3D pose. In addition, we compared the proposed 3D human pose recovery method with the commercial motion capture platform to prove the effectiveness of the proposed method. To make a contrast, we first built a motion capture platform through two Kinect (V2) devices and iPi Soft series software to obtain depth-camera video sequences and monocular-camera video sequences respectively. Then we defined several different tasks, including the speed of the movements, the position of the subject, the orientation of the subject, and the complexity of the movements. Experimental results show that our low-cost method based on RGB video data can achieve similar results to commercial motion capture platform with RGB-D video data.

A New Algorithm for Human Motion Capture via 3D Active Contours

Model-based markerless human body motion capture using active contour

Model-Based Markerless Human Body Motion Capture using Multiple Cameras

Human Body Motion Capture Via 3d Graph-Cuts

Markerless Human Body Motion Capture Using Multiple Cameras

Markerless Human Body Motion Capture Using Markov Random Field and Dynamic Graph Cuts

Marker-Less 3d Human Motion Capture With Monocular Image Sequence And Height-Maps

MODEL-BASEDMARKERLESS HUMAN BODY MOTION CAPTURE USINGMULTIPLE CAMERAS

General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Optimization and Soft Constraints for Human Shape and Pose Estimation Based on a 3D Morphable Model

Using compact distance energy model to recover human pose in markerless motion capture

Video Motion Capture in VBA—Video-based Animation

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

Marker-less Motion Capture Technology Based on Binocular Stereo Vision and Deep Learning

Motion Capture Research: 3D Human Pose Recovery Based on RGB Video Sequences

Towards Accurate Markerless Human Shape and Pose Estimation over Time

3D Human Mesh Estimation from Virtual Markers

Markerless Human Pose Estimation Using Image Features and Extremal Contour

A Markless 3D Human Motion Data Acquisition Method Based on the Binocular Stereo Vision and Lightweight Open Pose Algorithm

Multi-view Human Motion Capture with an Improved Deformation Skin Model