Abstract:Infrared and visible images (multi-sensor or multi-band images) have many complementary features which can effectively boost the performance of object detection. Recently, convolutional neural networks (CNNs) have seen frequent use to perform object detection in multi-band images. However, it is very difficult for CNNs to extract complementary features from infrared and visible images. In order to solve this problem, a difference maximum loss function is proposed in this paper. The loss function can guide the learning directions of two base CNNs and maximize the difference between features from the two base CNNs, so as to extract complementary and diverse features. In addition, we design a focused feature-enhancement module to make features in the shallow convolutional layer more significant. In this way, the detection performance of small objects can be effectively improved while not increasing the computational cost in the testing stage. Furthermore, since the actual receptive field is usually much smaller than the theoretical receptive field, the deep convolutional layer would not have sufficient semantic features for accurate detection of large objects. To overcome this drawback, a cascaded semantic extension module is added to the deep layer. Through simple multi-branch convolutional layers and dilated convolutions with different dilation rates, the cascaded semantic extension module can effectively enlarge the actual receptive field and increase the detection accuracy of large objects. We compare our detection network with five other state-of-the-art infrared and visible image object detection networks. Qualitative and quantitative experimental results prove the superiority of the proposed detection network.

VFEDet: a variational information bottleneck based feature enhancement object detection network

BFE-Net: Object Detection with Bidirectional Feature Enhancement

A Vision Enhancement and Feature Fusion Multiscale Detection Network

Refined Feature Enhancement Network for Object Detection

EBiDA-FPN: Enhanced Bi-Directional Attention Feature Pyramid Network for Object Detection

Feature Enhancement Network for Object Detection in Optical Remote Sensing Images

Deep Convolutional Feature Enhancement for Remote Sensing Object Detection

Infrared and Visible Image Object Detection via Focused Feature Enhancement and Cascaded Semantic Extension

FEFN: Feature Enhancement Feedforward Network for Lightweight Object Detection in Remote Sensing Images

Cascaded Detection Framework Based on a Novel Backbone Network and Feature Fusion

Feature-enhanced composite backbone network for object detection

Research on Feature Enhancement for Small Object Detection

DVFENet: Dual-branch voxel feature extraction network for 3D object detection

DetNet: A Backbone network for Object Detection

Comprehensive Feature Enhancement Module For Single-Shot Object Detector

FD2-Net: Frequency-Driven Feature Decomposition Network for Infrared-Visible Object Detection

Enhancement-fusion Feature Pyramid Network for Object Detection

When CNN meet with ViT: decision-level feature fusion for camouflaged object detection

MDFN: Multi-scale deep feature learning network for object detection

Small Object Detection Network Based on Feature Information Enhancement

EFR-FCOS: enhancing feature reuse for anchor-free object detector