Abstract:The advent of low-cost depth cameras, such as the Microsoft Kinect in the consumer market, has made many indoor applications and games based on motion tracking available to the everyday user. However, it is a large challenge to track human motion via such a camera because of its low-quality images, missing depth values, and noise. In this paper, we propose a novel human motion capture method based on a cooperative structure of multiple low-cost RGBD cameras, which can effectively avoid these problems. This structure can also manage the problem of body occlusions that appears when a single camera is used. Moreover, the whole process does not require training data, which makes this approach easily deployed and reduces operation time. We use the color image, depth image, and point cloud acquired in each view as the data source, and an initial pose is extracted in our optimization framework by aligning multiple point clouds from different cameras. The pose is dynamically updated by combining a filtering approach with a Markov model to estimate new poses in video streams. To verify the efficiency and robustness of our approach, we capture a wide variety of human actions via three cameras in indoor scenes and compare the tracking results of the proposed method to those of the current state-of-the-art methods. Moreover, our system is tested on more complex situations, in which multiple humans move within a scene, possibly occluding each other to some extent. The actions of multiple humans are tracked simultaneously, which would assist group behavior analysis.

Fast and Efficient Integration of Human Upper-Body Detection and Orientation Estimation in RGB-D Video

Efficient Multi-person Hierarchical 3D Pose Estimation for Autonomous Driving

Recurrent Volume-based 3D Feature Fusion for Real-time Multi-view Object Pose Estimation

Recurrent Volume-Based 3-D Feature Fusion for Real-Time Multiview Object Pose Estimation.

Fast Human Detection in RGB-D Images Based on Color-Depth Joint Feature Learning.

Accurate Estimation of Human Body Orientation from Rgb-D Sensors

Detecting and tracking people in real time with RGB-D camera

Upper Body Human Detection and Segmentation in Low Contrast Video

An ultra-fast human detection method for color-depth camera

Real-Time Accurate 3D Head Tracking and Pose Estimation with Consumer RGB-D Cameras

Towards Robust and Accurate Single-View Fast Human Motion Capture

Reliably Detecting Humans in Crowded and Dynamic Environments Using RGB-D Camera

Robust Human Detection with Super-Pixel Segmentation and Random Ferns Classification Using RGB-D Camera

Real-time human detection and tracking in complex environments using single RGBD camera

An RGB-D Based Approach for Human Pose Estimation

Joint Human Detection and Head Pose Estimation Via Multistream Networks for RGB-D Videos

Robust Real-Time Human Perception with Depth Camera.

Human Motion Tracking by Multiple RGBD Cameras.

Relative Pose Estimation for RGB-D Human Input Scans Via Implicit Function Reconstruction

3D Human Pose Estimation with Single Image and Inertial Measurement Unit (IMU) Sequence

Deep3DPose: Realtime Reconstruction of Arbitrarily Posed Human Bodies from Single RGB Images