Abstract:Infrared and visible images (multi-sensor or multi-band images) have many complementary features which can effectively boost the performance of object detection. Recently, convolutional neural networks (CNNs) have seen frequent use to perform object detection in multi-band images. However, it is very difficult for CNNs to extract complementary features from infrared and visible images. In order to solve this problem, a difference maximum loss function is proposed in this paper. The loss function can guide the learning directions of two base CNNs and maximize the difference between features from the two base CNNs, so as to extract complementary and diverse features. In addition, we design a focused feature-enhancement module to make features in the shallow convolutional layer more significant. In this way, the detection performance of small objects can be effectively improved while not increasing the computational cost in the testing stage. Furthermore, since the actual receptive field is usually much smaller than the theoretical receptive field, the deep convolutional layer would not have sufficient semantic features for accurate detection of large objects. To overcome this drawback, a cascaded semantic extension module is added to the deep layer. Through simple multi-branch convolutional layers and dilated convolutions with different dilation rates, the cascaded semantic extension module can effectively enlarge the actual receptive field and increase the detection accuracy of large objects. We compare our detection network with five other state-of-the-art infrared and visible image object detection networks. Qualitative and quantitative experimental results prove the superiority of the proposed detection network.

iffDetector: Inference-Aware Feature Filtering for Object Detection

Conscious Inference for Object Detection

An Adaptive Attention Fusion Mechanism Convolutional Network for Object Detection in Remote Sensing Images

FD2-Net: Frequency-Driven Feature Decomposition Network for Infrared-Visible Object Detection

Infrared and Visible Image Object Detection via Focused Feature Enhancement and Cascaded Semantic Extension

Improving Object Detection with Inverted Attention

Rifd-Cnn: Rotation-Invariant And Fisher Discriminative Convolutional Neural Networks For Object Detection

ICAFusion: Iterative cross-attention guided feature fusion for multispectral object detection

Feature Combination Based On Receptive Fields And Cross-Fusion Feature Pyramid For Object Detection

Adaptive Multi-Scale Information Flow for Object Detection.

Removal and Selection: Improving RGB-Infrared Object Detection via Coarse-to-Fine Fusion

FFEDet: Fine-Grained Feature Enhancement for Small Object Detection

MPF-Net: multi-projection filtering network for few-shot object detection

A Vision Enhancement and Feature Fusion Multiscale Detection Network

Exploring Context Information for Accurate and Fast Object Detection

Distilling Object Detectors With Fine-Grained Feature Imitation

MDFN: Multi-scale deep feature learning network for object detection

Small Object Detection via Coarse-to-fine Proposal Generation and Imitation Learning

Comprehensive Feature Enhancement Module For Single-Shot Object Detector

Learning Rotation-Invariant and Fisher Discriminative Convolutional Neural Networks for Object Detection.

Feature-aware and iterative refinement network for camouflaged object detection