Abstract:As a vital image enhancement technology, infrared and visible image fusion aims to generate high-quality fused images with salient targets and abundant texture in extreme environments. However, current image fusion methods are all designed for infrared and visible images with normal illumination. In the night scene, existing methods suffer from weak texture details and poor visual perception due to the severe degradation in visible images, which affects subsequent visual applications. To this end, this paper advances a darkness-free infrared and visible image fusion method (DIVFusion), which reasonably lights up the darkness and facilitates complementary information aggregation. Specifically, to improve the fusion quality of nighttime images, which suffer from low illumination, texture concealment, and color distortion, we first design a scene-illumination disentangled network (SIDNet) to strip the illumination degradation in nighttime visible images while preserving informative features of source images. Then, a texture-contrast enhancement fusion network (TCEFNet) is devised to integrate complementary information and enhance the contrast and texture details of fused features. Moreover, a color consistency loss is designed to mitigate color distortion from enhancement and fusion. Finally, we fully consider the intrinsic relationship between low-light image enhancement and image fusion, achieving effective coupling and reciprocity. In this way, the proposed method is able to generate fused images with real color and significant contrast in an end-to-end manner. Extensive experiments demonstrate that DIVFusion is superior to state-of-the-art algorithms in terms of visual quality and quantitative evaluations. Particularly, low-light enhancement and dual-modal fusion provide more effective information to the fused image and boost high-level vision tasks. Our code is publicly available at https://github.com/Xinyu-Xiang/DIVFusion.

LENFusion: A Joint Low-Light Enhancement and Fusion Network for Nighttime Infrared and Visible Image Fusion

Beyond Night Visibility: Adaptive Multi-Scale Fusion of Infrared and Visible Images

Image Fusion for Enhanced Nighttime Visibility Using Knowledge Distillation

DIVFusion: Darkness-free infrared and visible image fusion

An interactive deep model combined with Retinex for low-light visible and infrared image fusion

LVIF-Net: Learning synchronous visible and infrared image fusion and enhancement under low-light conditions

Fusion of the Low-Light-level Visible and Infrared Images for Night-Vision Context Enhancement

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

EV-Fusion: A Novel Infrared and Low-Light Color Visible Image Fusion Network Integrating Unsupervised Visible Image Enhancement

LiMFusion: Infrared and Visible Image Fusion Via Local Information Measurement

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

Infrared and Harsh Light Visible Image Fusion Using an Environmental Light Perception Network

FAFusion: Learning for Infrared and Visible Image Fusion via Frequency Awareness

MLFFusion: Multi-level Feature Fusion Network with Region Illumination Retention for Infrared and Visible Image Fusion

SeACPFusion: an Adaptive Fusion Network for Infrared and Visible Images Based on Brightness Perception

Luminance-Preserving Visible and Near-Infrared Image Fusion Network with Edge Guidance

Low-light Infrared and Visible Image Fusion with Imbalanced Thermal Radiation Distribution

AFIRE: Adaptive FusionNet for Illumination-Robust Feature Extraction in Heterogeneous Imaging Environments

LRFE-CL: A self-supervised fusion network for infrared and visible image via low redundancy feature extraction and contrastive learning

DCBFusion: an Infrared and Visible Image Fusion Method Through Detail Enhancement, Contrast Reserve and Brightness Balance

SimpleFusion: A Simple Fusion Framework for Infrared and Visible Images