Abstract:As a vital image enhancement technology, infrared and visible image fusion aims to generate high-quality fused images with salient targets and abundant texture in extreme environments. However, current image fusion methods are all designed for infrared and visible images with normal illumination. In the night scene, existing methods suffer from weak texture details and poor visual perception due to the severe degradation in visible images, which affects subsequent visual applications. To this end, this paper advances a darkness-free infrared and visible image fusion method (DIVFusion), which reasonably lights up the darkness and facilitates complementary information aggregation. Specifically, to improve the fusion quality of nighttime images, which suffer from low illumination, texture concealment, and color distortion, we first design a scene-illumination disentangled network (SIDNet) to strip the illumination degradation in nighttime visible images while preserving informative features of source images. Then, a texture-contrast enhancement fusion network (TCEFNet) is devised to integrate complementary information and enhance the contrast and texture details of fused features. Moreover, a color consistency loss is designed to mitigate color distortion from enhancement and fusion. Finally, we fully consider the intrinsic relationship between low-light image enhancement and image fusion, achieving effective coupling and reciprocity. In this way, the proposed method is able to generate fused images with real color and significant contrast in an end-to-end manner. Extensive experiments demonstrate that DIVFusion is superior to state-of-the-art algorithms in terms of visual quality and quantitative evaluations. Particularly, low-light enhancement and dual-modal fusion provide more effective information to the fused image and boost high-level vision tasks. Our code is publicly available at https://github.com/Xinyu-Xiang/DIVFusion.

Infrared and Visible Light Fusion for Object Detection with Low-light Enhancement

Infrared and visible image fusion method based on saliency detection and target-enhancement

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

LLOD:A Object Detection Method under Low-Light Condition by Feature Enhancement and Fusion

Beyond Night Visibility: Adaptive Multi-Scale Fusion of Infrared and Visible Images

Multispectral Deep Neural Network Fusion Method for Low-Light Object Detection

Infrared Dim and Small Target Detection Based on Local–Global Feature Fusion

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

EV-Fusion: A Novel Infrared and Low-Light Color Visible Image Fusion Network Integrating Unsupervised Visible Image Enhancement

Low-light Object Detection

Lightweight Spatial Sliced-Concatenate-Multireceptive-Field Enhance and Joint Channel Attention Mechanism for Infrared Object Detection

Removal and Selection: Improving RGB-Infrared Object Detection via Coarse-to-Fine Fusion

Infrared and Visible Image Fusion Using Threshold Segmentation and Weight Optimization

LVIF-Net: Learning synchronous visible and infrared image fusion and enhancement under low-light conditions

DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion.

An object detection algorithm based on infrared-visible dual modal feature fusion

DIVFusion: Darkness-free infrared and visible image fusion

Research on fusion technology based on low-light visible image and infrared image

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

Infrared and visual image fusion enhancement by dual-transform

Dynamic Low-Light Image Enhancement for Object Detection Via End-to-End Training.