Abstract:The advent of low-cost depth cameras, such as the Microsoft Kinect in the consumer market, has made many indoor applications and games based on motion tracking available to the everyday user. However, it is a large challenge to track human motion via such a camera because of its low-quality images, missing depth values, and noise. In this paper, we propose a novel human motion capture method based on a cooperative structure of multiple low-cost RGBD cameras, which can effectively avoid these problems. This structure can also manage the problem of body occlusions that appears when a single camera is used. Moreover, the whole process does not require training data, which makes this approach easily deployed and reduces operation time. We use the color image, depth image, and point cloud acquired in each view as the data source, and an initial pose is extracted in our optimization framework by aligning multiple point clouds from different cameras. The pose is dynamically updated by combining a filtering approach with a Markov model to estimate new poses in video streams. To verify the efficiency and robustness of our approach, we capture a wide variety of human actions via three cameras in indoor scenes and compare the tracking results of the proposed method to those of the current state-of-the-art methods. Moreover, our system is tested on more complex situations, in which multiple humans move within a scene, possibly occluding each other to some extent. The actions of multiple humans are tracked simultaneously, which would assist group behavior analysis.

A new approach for tracking human body movements by kinect sensor

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

Trajectory Tracking of Joint Based on Kinect

Data Fusion of Human Skeleton Joint Tracking Using Two Kinect Sensors and Extended Set Membership Filter

Tracking Human-like Natural Motion Using Deep Recurrent Neural Networks

Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture

Using a Kinect Sensor to Acquire Biological Motion: Toolbox and Evaluation.

Human Motion Tracking by Multiple RGBD Cameras.

Observation-oriented silhouette-aware fast full body tracking with Kinect

An Adaptive Approach to Human Motion Tracking from Video

Leveraging Two Kinect Sensors for Accurate Full-Body Motion Capture

A Kinect-Based Motion Capture Method for Assessment of Lower Extremity Exoskeleton

Kinect as a Tool for Gait Analysis: Validation of a Real-Time Joint Extraction Algorithm Working in Side View

Markerless Motion Capture Using Appearance and Inertial Data

Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors

Human gait capture by tracking joint motion based on Kalman Filter

A Novel Vision-Based Human Motion Capture System Using Dual-Kinect

Real-time Detecting System of High Knee Movement Based on Kinect

High-Accuracy Real-Time Whole-Body Human Motion Tracking Based on Constrained Nonlinear Kalman Filtering

Multiple Kinect based system to monitor and analyze key performance indicators of physical training

A Novel Automatic Tracking Method of Moving Image Sequence Marker Points Uses Kinect and Wireless Network Technology