Moving target tracking of mobile robots with fusion of laser scanner and monocular camera

Jing YUAN,Gang-dun LIU,Qin-xuan SUN

DOI: https://doi.org/10.7641/CTA.2016.50085

2016-01-01

Abstract:Moving target tracking with mobile robots in the indoor environments is addressed. A method to localize the robot and estimate the moving target’s states is proposed based on information fusion of a laser scanner and a monocular camera. First, moving target detection, robot self-localization and map building of the environment are simultaneously accomplished using the laser data. Then, a monocular vision-based scheme to detect the target’s location is developed for measuring the range and bearing of the target. To achieve effective fusion between two kinds of sensor information, the laser scanner and the monocular camera are jointly calibrated to obtain the relative coordinate transform between them. Finally, a particle filter (PF) with the optimal importance function and importance weights is designed to fuse the measurements of the target’s range and bearing from the laser scanner and the monocular camera. The experimental results show that the proposed method can achieve satisfactory tracking performances.