Abstract:The advent of low-cost depth cameras, such as the Microsoft Kinect in the consumer market, has made many indoor applications and games based on motion tracking available to the everyday user. However, it is a large challenge to track human motion via such a camera because of its low-quality images, missing depth values, and noise. In this paper, we propose a novel human motion capture method based on a cooperative structure of multiple low-cost RGBD cameras, which can effectively avoid these problems. This structure can also manage the problem of body occlusions that appears when a single camera is used. Moreover, the whole process does not require training data, which makes this approach easily deployed and reduces operation time. We use the color image, depth image, and point cloud acquired in each view as the data source, and an initial pose is extracted in our optimization framework by aligning multiple point clouds from different cameras. The pose is dynamically updated by combining a filtering approach with a Markov model to estimate new poses in video streams. To verify the efficiency and robustness of our approach, we capture a wide variety of human actions via three cameras in indoor scenes and compare the tracking results of the proposed method to those of the current state-of-the-art methods. Moreover, our system is tested on more complex situations, in which multiple humans move within a scene, possibly occluding each other to some extent. The actions of multiple humans are tracked simultaneously, which would assist group behavior analysis.

2-D Model Based Tracking of Human Motion

Research and Realization on Moving Object Detection and Tracking Methods of Human

Human Pose Tracking Algorithm Based on Skeleton-Texture Model

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Tracking human under occlusion based on kernel density estimation

An Adaptive Approach to Human Motion Tracking from Video

Human motion tracking and 3D motion track detection technology based on visual information features and machine learning

Human motion tracking based on shape analysis

H uman motion tracking bsa ed on an improved invre se kinematics

An efficient stochastic framework for 3D human motion tracking

Automatic tracking of moving human body based on remote sensing spatial information

Motion Targets Tracking Algorithm Based on Video Surveillance

Human Motion Tracking Using 3D Image Features with a Long Short-Term Memory Mechanism Model—An Example of Forward Reaching

Human Motion Tracking by Registering an Articulated Surface to 3-D Points and Normals

Reconstruction of 3D Human Motion Using Multiple View L1 Trackers

Combining template matching and model fitting for human body segmentation and tracking with applications to sports training

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

Visual Tracking Via Subspace Motion Model

Research On Feature Tracking Algorithm Based On Two Cameras

Human Motion Recognition in Video

Human Motion Tracking by Multiple RGBD Cameras.