Abstract:As a vital image enhancement technology, infrared and visible image fusion aims to generate high-quality fused images with salient targets and abundant texture in extreme environments. However, current image fusion methods are all designed for infrared and visible images with normal illumination. In the night scene, existing methods suffer from weak texture details and poor visual perception due to the severe degradation in visible images, which affects subsequent visual applications. To this end, this paper advances a darkness-free infrared and visible image fusion method (DIVFusion), which reasonably lights up the darkness and facilitates complementary information aggregation. Specifically, to improve the fusion quality of nighttime images, which suffer from low illumination, texture concealment, and color distortion, we first design a scene-illumination disentangled network (SIDNet) to strip the illumination degradation in nighttime visible images while preserving informative features of source images. Then, a texture-contrast enhancement fusion network (TCEFNet) is devised to integrate complementary information and enhance the contrast and texture details of fused features. Moreover, a color consistency loss is designed to mitigate color distortion from enhancement and fusion. Finally, we fully consider the intrinsic relationship between low-light image enhancement and image fusion, achieving effective coupling and reciprocity. In this way, the proposed method is able to generate fused images with real color and significant contrast in an end-to-end manner. Extensive experiments demonstrate that DIVFusion is superior to state-of-the-art algorithms in terms of visual quality and quantitative evaluations. Particularly, low-light enhancement and dual-modal fusion provide more effective information to the fused image and boost high-level vision tasks. Our code is publicly available at https://github.com/Xinyu-Xiang/DIVFusion.

Scene Fusion System Based on Ambient Light Detection

Detail Preserving Exposure Fusion for A Dual Sensor Camera

Multi-exposure image fusion based on well-exposedness assessment

Fusion Algorithm of Laser-Point Clouds and Optical Images

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

A 360-degree floating 3D display based on light field regeneration.

Self‐calibration Three‐dimensional Light Field Display Based on Scalable Multi‐lcds

P.54: Light Field Integral Display Using LCD and Eye Tracking Technique

Integral Imaging Display for Natural Scene Based on KinectFusion

A robust infrared and visible image fusion framework via multi-receptive-field attention and color visual perception

Stereo Content Fusion Display Technology Research Based on Eye Tracking

SPFusion: A multi-task semantic perception infrared and visible light fusion method with quality assessment

HeteroFusion: Dense Scene Reconstruction Integrating Multi-Sensors.

COLOR CONTRAST ENHANCEMENT METHOD TO IMPROVE TARGET DETECTABILITY IN NIGHT VISION FUSION

Adaptive Fusion Algorithm of Heterogeneous Sensor Networks under Different Illumination Conditions

Infrared and Visible Imagery Fusion Based on Region Saliency Detection for 24-Hour-surveillance Systems

Color night vision method based on the correlation between natural color and dual band night image

Color-compensated multi-scale exposure fusion based on physical features

Multi-exposure electric power monitoring image fusion method without ghosting based on exposure fusion framework and color dissimilarity feature

DIVFusion: Darkness-free infrared and visible image fusion

FastFusion: Real-Time Indoor Scene Reconstruction with Fast Sensor Motion