Research on Fusion Method of Lidar and Visual Image Based on Surface Vehicle

Jie Yang,Dian Lin,Qingnian Zhang,Yongmei Ren
DOI: https://doi.org/10.1109/ICCAR.2019.8813730
2019-01-01
Abstract:Environmental perception is one of the most significant parts of ship intelligence. Effective detection of obstacles is beneficial to avoid hitting into obstacles. At present, the technology of sensors that is used more and mature are mainly distance sensors and image sensors. The distance sensors, typically, the laser radar (Lidar), and the image sensors are typically cameras. The camera can capture a two-dimensional color image with texture, which can be helpful for the recognition of obstacles. Lidar scanner has the advantage of detecting the obstacles in a further distance and presenting the 3D point cloud. The characteristics of the two sensors are quite different, which means finding the mapping between them can combine both characteristics to detect obstacles. In this paper, the two sensors are calibrated separately to calculate the mapping relationship between distance and image sensors, and the error is calculated to verify the accuracy.
What problem does this paper attempt to address?