Abstract:In the field of remote sensing image applications, RGB and infrared image object detection is an important technology. The object detection performance can be improved and the robustness of the algorithm will be enhanced by making full use of their complementary information. Existing RGB-infrared detection methods do not explicitly encourage RGB and infrared images to achieve effective multimodal learning. We find that when fusing RGB and infrared images, cross-modal redundant information weakens the degree of complementary information fusion. Inspired by this observation, we propose a redundant information suppression network (RISNet) which suppresses cross-modal redundant information and facilitates the fusion of RGB-Infrared complementary information. Specifically, we design a novel mutual information minimization module to reduce the redundancy between RGB appearance features and infrared radiation features, which enables the network to take full advantage of the complementary advantages of multimodality and improve the object detection performance. In addition, in view of the drawbacks of the current artificial classification of lighting conditions, such as the subjectivity of artificial classification and the lack of comprehensiveness (divided into day and night only), we propose a method based on histogram statistics to classify lighting conditions in more detail. Experimental results on two public RGB-infrared object detection datasets demonstrate the superiorities of our proposed method over the state-of-the-art approaches, especially under challenging conditions such as poor illumination, complex background, and low contrast.

Cross-domain colorization of unpaired infrared images through contrastive learning guided by color feature selection attention

Contrastive learning with feature fusion for unpaired thermal infrared image colorization

Infrared colorization with cross-modality zero-shot learning

Domain Adaptation for Infrared-Radar Cross-Scene Multimodal Detection

Towards RGB-NIR Cross-modality Image Registration and Beyond

Cross-domain attention network for hyperspectral image classification

Cross-Spectral Attention for Unsupervised RGB-IR Face Verification and Person Re-identification

Learning Enriched Illuminants for Cross and Single Sensor Color Constancy

Cooperative Colorization: Exploring Latent Cross-Domain Priors for NIR Image Spectrum Translation

DBSF-Net: Infrared Image Colorization Based on the Generative Adversarial Model with Dual-Branch Feature Extraction and Spatial-Frequency-Domain Discrimination

Cross-Domain Learning for Reference-Based Sketch Colorization with Structural and Colorific Strategy.

Enhanced Cross-Domain Dim and Small Infrared Target Detection via Content-Decoupled Feature Alignment

Improving RGB-Infrared Object Detection by Reducing Cross-Modality Redundancy

Infrared and Visible Cross-Modal Image Retrieval Through Shared Features

Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labels

Infrared Image Generation Based on Visual State Space and Contrastive Learning

CLCC: Contrastive Learning for Color Constancy

Translation, Scale and Rotation: Cross-Modal Alignment Meets RGB-Infrared Vehicle Detection

Transferable Feature Representation for Visible-to-Infrared Cross-Dataset Human Action Recognition

Cross-UNet: dual-branch infrared and visible image fusion framework based on cross-convolution and attention mechanism

An infrared pedestrian detection method based on segmentation and domain adaptation learning