Abstract:Infrared and visible images (multi-sensor or multi-band images) have many complementary features which can effectively boost the performance of object detection. Recently, convolutional neural networks (CNNs) have seen frequent use to perform object detection in multi-band images. However, it is very difficult for CNNs to extract complementary features from infrared and visible images. In order to solve this problem, a difference maximum loss function is proposed in this paper. The loss function can guide the learning directions of two base CNNs and maximize the difference between features from the two base CNNs, so as to extract complementary and diverse features. In addition, we design a focused feature-enhancement module to make features in the shallow convolutional layer more significant. In this way, the detection performance of small objects can be effectively improved while not increasing the computational cost in the testing stage. Furthermore, since the actual receptive field is usually much smaller than the theoretical receptive field, the deep convolutional layer would not have sufficient semantic features for accurate detection of large objects. To overcome this drawback, a cascaded semantic extension module is added to the deep layer. Through simple multi-branch convolutional layers and dilated convolutions with different dilation rates, the cascaded semantic extension module can effectively enlarge the actual receptive field and increase the detection accuracy of large objects. We compare our detection network with five other state-of-the-art infrared and visible image object detection networks. Qualitative and quantitative experimental results prove the superiority of the proposed detection network.

Multi-level feature enhancement network for object detection in sonar images

Dual-Branch Feature Fusion Network for Salient Object Detection

Sonar Image Target Detection Based on Adaptive Global Feature Enhancement Network

RMFENet: Refined Multiscale Feature Enhancement Network for Arbitrary-Oriented Sonar Object Detection

Multi-Scale Feature Fusion Enhancement for Underwater Object Detection

CenterNet-Saccade: Enhancing Sonar Object Detection with Lightweight Global Feature Extraction

Dual Spatial Attention Network for Underwater Object Detection With Sonar Imagery

Improving Multiscale Object Detection With Off-Centered Semantics Refinement

Multi-scale aggregation feature pyramid with cornerness for underwater object detection

Scale Enhancement Network for Object Detection in Aerial Images

Deep Convolutional Feature Enhancement for Remote Sensing Object Detection

Infrared and Visible Image Object Detection via Focused Feature Enhancement and Cascaded Semantic Extension

Spatial attention-guided deformable fusion network for salient object detection

Cross stage partial connections based weighted Bi-directional feature pyramid and enhanced spatial transformation network for robust object detection

Multi-branch feature fusion and refinement network for salient object detection

Multi-Scale Marine Object Detection in Side-Scan Sonar Images Based on BES-YOLO

An improved object detection algorithm based on multi-scaled and deformable convolutional neural networks

An Object Enhancement Method for Forward-Looking Sonar Images Based on Multi-Frame Fusion

Multi-Scale Interactive Network for Salient Object Detection

Spatial Information Enhancement with Multi-Scale Feature Aggregation for Long-Range Object and Small Reflective Area Object Detection from Point Cloud

Infrared Maritime Object Detection Network With Feature Enhancement and Adjacent Fusion