Abstract:Multimodal data fusion plays an increasingly important role in the field of artificial intelligence . The objective of Infrared and Visible Image Fusion (IVF) is to integrate information from different types of images to enhance the performance of target detection tasks. Meanwhile, object detection technology constitutes a crucial foundation in the field of autonomous driving. However, visible images captured under low illumination often lack important details, resulting in suboptimal fusion results,which in turn affects the accuracy of target detection tasks. We proposed an infrared and visible image fusion method based on adaptive visual enhancement and structural patch decomposition (ASFusion) to address the above issues. First, we design an efficient algorithm based on the camera response model to enhance different exposure matrices, allowing for adaptive enhancement of visible images. Second, we decompose the source infrared and the enhanced visible image into three components: mean intensity, signal structure, and signal intensity using structural patch decomposition (SPD), and then design a new degree of membership curve function to estimate the weight of the average intensity component accurately. The estimation process reduces artifacts and preserves the significance of infrared targets. Third, to achieve a higher contrast in the fusion result, we introduced sharpening operations to enhance the detail layer of both the infrared and visible images. Finally, the fused image is obtained by merging the base and detail layers. Through qualitative and quantitative experimental evaluations, the proposed method outperforms twelve state-of-the-art image fusion methods. Additionally, object detection experiments have demonstrated that our ASFusion exhibits tremendous potential in better serving advanced computer vision tasks. Our code is publicly available at https://github.com/ZhouVMC/ASFusion .

Perceptual-Based Fusion Of Ir And Visual Images For Human Detection

Fusion of infrared and visual images through multiscale hybrid unidirectional total variation

A perceptual framework for infrared-visible image fusion based on multiscale structure decomposition and biological vision

Infrared and Visible Image Fusion with Hierarchical Human Perception

Infrared and Visible Imagery Fusion Based on Region Saliency Detection for 24-Hour-surveillance Systems

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Beyond Night Visibility: Adaptive Multi-Scale Fusion of Infrared and Visible Images

Multi-Scale Fusion of Stretched Infrared and Visible Images

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

Infrared dual-band image fusion with simplified pulse coupled neural network and visual saliency map in nonsubsampled shearlet transform domain

Multi-scale infrared and visible image fusion framework based on dual partial differential equations

DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion.

A robust infrared and visible image fusion framework via multi-receptive-field attention and color visual perception

Infrared and visible image fusion based on infrared background suppression

Bi-channel Video Fusion Human Invasion Detection Based on Neural Network

Infrared and visible image fusion based on saliency detection and deep multi-scale orientational features

Multi-Sensor Fusion of Infrared and Visible Images Based on Modified Side Window Filter and Intensity Transformation

ASFusion: Adaptive visual enhancement and structural patch decomposition for infrared and visible image fusion

Infrared and Visible Image Fusion with Hybrid Image Filtering

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

An Interactively Reinforced Paradigm for Joint Infrared-Visible Image Fusion and Saliency Object Detection