Abstract:The advent of low-cost depth cameras, such as the Microsoft Kinect in the consumer market, has made many indoor applications and games based on motion tracking available to the everyday user. However, it is a large challenge to track human motion via such a camera because of its low-quality images, missing depth values, and noise. In this paper, we propose a novel human motion capture method based on a cooperative structure of multiple low-cost RGBD cameras, which can effectively avoid these problems. This structure can also manage the problem of body occlusions that appears when a single camera is used. Moreover, the whole process does not require training data, which makes this approach easily deployed and reduces operation time. We use the color image, depth image, and point cloud acquired in each view as the data source, and an initial pose is extracted in our optimization framework by aligning multiple point clouds from different cameras. The pose is dynamically updated by combining a filtering approach with a Markov model to estimate new poses in video streams. To verify the efficiency and robustness of our approach, we capture a wide variety of human actions via three cameras in indoor scenes and compare the tracking results of the proposed method to those of the current state-of-the-art methods. Moreover, our system is tested on more complex situations, in which multiple humans move within a scene, possibly occluding each other to some extent. The actions of multiple humans are tracked simultaneously, which would assist group behavior analysis.

Hand and body association in crowded environments for human-robot interaction

Hand Posture Recognition and Tracking Based on Bag-of-Words for Human Robot Interaction

A Haptic Shared Control Architecture for Tracking of a Moving Object.

A Human-Robot Collaboration System for Object Handover

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

Human Localization in a Cluttered Space Using Multiple Cameras

Body-Part Joint Detection and Association via Extended Object Representation

Full-body Motion Capture for Multiple Closely Interacting Persons.

Multiple Human Association and Tracking from Egocentric and Complementary Top Views

Two Hands Are Better Than One: Resolving Hand to Hand Intersections via Occupancy Networks

Robust human position estimation in cooperative robotic cells

Multi-View Active Sensing for Human-Robot Interaction via Hierarchically Connected Tree

Omnidirectional Vision for Mobile Robot Human Body Detection and Localization

A Multi-sensor Gesture Interaction System for Human-robot Cooperation

Multi-Camera Hand-Eye Calibration for Human-Robot Collaboration in Industrial Robotic Workcells

CobotGear: Interaction with Collaborative Robots using Wearable Optical Motion Capturing Systems

Deep Detection of People and their Mobility Aids for a Hospital Robot

Human Posture Recognition for Human-Robot Interaction

PBADet: A One-Stage Anchor-Free Approach for Part-Body Association

Human Motion Tracking by Multiple RGBD Cameras.

A 3D Hand Attitude Estimation Method for Fixed Hand Posture Based on Dual-View RGB Images