Abstract:Multimodal data fusion plays an increasingly important role in the field of artificial intelligence . The objective of Infrared and Visible Image Fusion (IVF) is to integrate information from different types of images to enhance the performance of target detection tasks. Meanwhile, object detection technology constitutes a crucial foundation in the field of autonomous driving. However, visible images captured under low illumination often lack important details, resulting in suboptimal fusion results,which in turn affects the accuracy of target detection tasks. We proposed an infrared and visible image fusion method based on adaptive visual enhancement and structural patch decomposition (ASFusion) to address the above issues. First, we design an efficient algorithm based on the camera response model to enhance different exposure matrices, allowing for adaptive enhancement of visible images. Second, we decompose the source infrared and the enhanced visible image into three components: mean intensity, signal structure, and signal intensity using structural patch decomposition (SPD), and then design a new degree of membership curve function to estimate the weight of the average intensity component accurately. The estimation process reduces artifacts and preserves the significance of infrared targets. Third, to achieve a higher contrast in the fusion result, we introduced sharpening operations to enhance the detail layer of both the infrared and visible images. Finally, the fused image is obtained by merging the base and detail layers. Through qualitative and quantitative experimental evaluations, the proposed method outperforms twelve state-of-the-art image fusion methods. Additionally, object detection experiments have demonstrated that our ASFusion exhibits tremendous potential in better serving advanced computer vision tasks. Our code is publicly available at https://github.com/ZhouVMC/ASFusion .

Adaptive Fusion Algorithm of Heterogeneous Sensor Networks under Different Illumination Conditions

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

A Fusion Framework For Face Recognition Under Varying Illumination Based On Multi-Scale Analysis

An Adaptive Fuzzy Fusion Framework for Face Recognition under Illumination Variation Based on Local Multiple Patterns.

The Realistic Fusion of Multi-spectral Images

Decision Fusion Transmitted over Fading Channels in Wireless Sensor Networks

Infrared and Visible Image Fusion Based on a Two-Stage Class Conditioned Auto-Encoder Network.

SPFusion: A multi-task semantic perception infrared and visible light fusion method with quality assessment

Beyond Night Visibility: Adaptive Multi-Scale Fusion of Infrared and Visible Images

Infrared and Visible Image Fusion under Different Illumination Conditions Based on Illumination Effective Region Map.

An image fusion algorithm based on image clustering theory

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

Infrared and Harsh Light Visible Image Fusion Using an Environmental Light Perception Network

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

Adaptive-SFSDAF for Spatiotemporal Image Fusion that Selectively Uses Class Abundance Change Information

Research on fusion technology based on low-light visible image and infrared image

IETAFusion: An illumination enhancement and target‐aware infrared and visible image fusion network for security system of smart city

Multi-Focus Image Fusion Algorithm in Sensor Networks

ASFusion: Adaptive visual enhancement and structural patch decomposition for infrared and visible image fusion

An Infrared and Visible Image Fusion Method Based on Adaptive Weight Learning

TGLFusion: A Temperature-Guided Lightweight Fusion Method for Infrared and Visible Images