Abstract:Acquiring the accurate three-dimensional (3-D) position of a target person around a robot provides valuable information that is applicable to a wide range of robotic tasks, especially for promoting the intelligent manufacturing processes of industries. This paper presents a real-time robotic 3-D human tracking system that combines a monocular camera with an ultrasonic sensor by an extended Kalman filter (EKF). The proposed system consists of three submodules: a monocular camera sensor tracking module, an ultrasonic sensor tracking module, and the multisensor fusion algorithm. An improved visual tracking algorithm is presented to provide 2-D partial location estimation. The algorithm is designed to overcome severe occlusions, scale variation, target missing, and achieve robust redetection. The scale accuracy is further enhanced by the estimated 3-D information. An ultrasonic sensor array is employed to provide the range information from the target person to the robot, and time of flight is used for the 2-D partial location estimation. EKF is adopted to sequentially process multiple, heterogeneous measurements arriving in an asynchronous order fromthe vision sensor, and the ultrasonic sensor separately. In the experiments, the proposed tracking system is tested in both a simulation platform and actual mobile robot for various indoor and outdoor scenes. The experimental results show the persuasive performance of the 3-D tracking system in terms of both the accuracy and robustness.

A Systematic Solution for Moving-Target Detection and Tracking While Only Using a Monocular Camera

A Moving Target Detection and Localization Strategy Based on Optical Flow and Pin-hole Imaging Methods Using Monocular Vision

Accurate and Real-Time 3-D Tracking for the Following Robots by Fusing Vision and Ultrasonar Information

Detecting and Tracking Dynamic Objects in Complex Environments

Motion Detection For Multiple Moving Targets By Using An Onmidirectional Camera

Motion detection for multiple moving targets by using an omnidirectional camera

Moving target tracking using sparse optical flow method

A Method of Target Tracking Based on Monocular Vision for Mobile Robot in Unknown Environment

3D Target Detection and Tracking Based on Scene Flow

Mobile Target Tracking Based on Hybrid Open-Loop Monocular Vision Motion Control Strategy

Motion Targets Tracking Algorithm Based on Video Surveillance

Dynamic Target Tracking and Ingressing of a Small UAV Using Monocular Sensor Based on the Geometric Constraints

Non-line-of-sight imaging and tracking of moving objects based on deep learning

An Improved Real-Time Visual Tracking Method for Space Non-Cooperative Target

A Novel Method for Space Circular Target Detection in Machine Vision

Automatic 3D Tracking System for Large Swarm of Moving Objects

Delving into Motion-Aware Matching for Monocular 3D Object Tracking

Convolutional Neural Network for Monocular Vision-based Multi-target Tracking

Application of Three-Dimensional Filtering to Moving Target Detection

Cognitively Inspired 6D Motion Estimation of a Noncooperative Target Using Monocular RGB-D Images

An Active Multi-Object Ultrafast Tracking System with CNN-Based Hybrid Object Detection