Abstract:As a vital image enhancement technology, infrared and visible image fusion aims to generate high-quality fused images with salient targets and abundant texture in extreme environments. However, current image fusion methods are all designed for infrared and visible images with normal illumination. In the night scene, existing methods suffer from weak texture details and poor visual perception due to the severe degradation in visible images, which affects subsequent visual applications. To this end, this paper advances a darkness-free infrared and visible image fusion method (DIVFusion), which reasonably lights up the darkness and facilitates complementary information aggregation. Specifically, to improve the fusion quality of nighttime images, which suffer from low illumination, texture concealment, and color distortion, we first design a scene-illumination disentangled network (SIDNet) to strip the illumination degradation in nighttime visible images while preserving informative features of source images. Then, a texture-contrast enhancement fusion network (TCEFNet) is devised to integrate complementary information and enhance the contrast and texture details of fused features. Moreover, a color consistency loss is designed to mitigate color distortion from enhancement and fusion. Finally, we fully consider the intrinsic relationship between low-light image enhancement and image fusion, achieving effective coupling and reciprocity. In this way, the proposed method is able to generate fused images with real color and significant contrast in an end-to-end manner. Extensive experiments demonstrate that DIVFusion is superior to state-of-the-art algorithms in terms of visual quality and quantitative evaluations. Particularly, low-light enhancement and dual-modal fusion provide more effective information to the fused image and boost high-level vision tasks. Our code is publicly available at https://github.com/Xinyu-Xiang/DIVFusion.

New Fusion Based Enhancement for Text Detection in Night Video Footage

A New Multi-spectral Fusion Method for Degraded Video Text Frame Enhancement.

Patch-Based Approach for the Fusion of Low-Light Image Pairs

Enhancing Nighttime Surveillance Video Via Gradient Fusion.

Beyond Night Visibility: Adaptive Multi-Scale Fusion of Infrared and Visible Images

LENFusion: A Joint Low-Light Enhancement and Fusion Network for Nighttime Infrared and Visible Image Fusion

COLOR CONTRAST ENHANCEMENT METHOD TO IMPROVE TARGET DETECTABILITY IN NIGHT VISION FUSION

Fusion-Based Low-Light Image Enhancement

DIVFusion: Darkness-free infrared and visible image fusion

Cross-modality feature fusion for night pedestrian detection

Multi-Spectral Fusion Based Approach for Arbitrarily Oriented Scene Text Detection in Video Images

Night Vision Image Fusion Based on Phase Information Modulation and Image Enhancement Technique

A New DCT-FFT Fusion Based Method for Caption and Scene Text Classification in Action Video Images.

Texture fusion based wavelet transform applied to video text enhancement

A novel multi-scale fusion framework for detail-preserving low-light image enhancement

A Fusion-Based Method For Single Backlit Image Enhancement

Attention-Guided Multi-Scale Feature Fusion Network for Low-Light Image Enhancement

Towards Robust Video Text Detection with Spatio-Temporal Attention Modeling and Text Cues Fusion

Text-DiFuse: An Interactive Multi-Modal Image Fusion Framework based on Text-modulated Diffusion Model

EEMEFN: Low-Light Image Enhancement Via Edge-Enhanced Multi-Exposure Fusion Network

A Fusion-Based Enhancing Method for Weakly Illuminated Images