Multi-Modal Ship Object Detection in Optical and SAR Images

Wang Yong,Li Ling,Tan Xiao,Ji Bing
DOI: https://doi.org/10.1109/icipca61593.2024.10709219
2024-01-01
Abstract:Ship object detection is one of the key technologies in the fields of maritime traffic monitoring, maintenance of maritime rights and interests, and coastal defense early warning detection. Optical remote sensing data contains rich texture information, which is conducive to target recognition, but it is highly depends on light and can only be used during the day. The influence of light on synthetic aperture radar (SAR) data is negligible, so it can be used all-weather, but it is difficult to accurately distinguish ship targets due to the lack of texture information. In order to comprehensively utilize two different data and fully leverage their respective advantages, a multimodal ship object rotated detection algorithm is proposed. Feature extraction is conducted separately for optical and SAR data, and an intermediate fusion strategy is adopted to achieve the fusion and detection of optical and SAR features. The introduction of CBAM (Convolutional Block Attention Module) in the backbone facilitates automatic identification of the weight of each feature channel during the learning process, which enhances the effect of feature extraction and suppresses noise and irrelevant information. The proposed multimodal detection algorithm has been validated on the constructed QXS-SAROPT-SHIP dataset. Compared with typical horizontal bounding box detection and single-modal detection algorithms, the accuracy rate of the proposed multimodal detection algorithm has been significantly improved. Specifically, the accuracy of the multimodal detection algorithm with CBAM module has been increased by 1.73%, demonstrating the effectiveness of the proposed method.
What problem does this paper attempt to address?