Abstract:In the task of fusing infrared and visible images, the extraction of features and fusion strategy significantly impacts the outcome of the fusion. However, prevailing fusion methods are often manually designed, unlearnable, and neglect to consider context adequately. To address these issues, this paper introduces a distributed architecture network based on attention mechanism and dense dilated convolution, realizing three-channel data fusion. This network employs a distributed fusion framework to fully utilize the fusion output of the previous step, capitalizing effectively on the target and texture information in infrared and visible images. Initially, two channels gather ample context from the source images through a dense dilated convolution module with multiscale channel attention. Subsequently, a fusion strategy based on coordinate mean attention is adopted to facilitate the fusion of results between the two channels. Then, the fused features and the preceding fusion results are fed into the fusion channel, minimizing loss of target and texture information in infrared and visible images. Furthermore, we incorporate an edge correction block, capable of refining the edge details of the fusion results and effectively suppressing noise. The proposed method demonstrates good fusion performance and extensive ablation experiments validate the effectiveness of the proposed methodology. Simultaneously, both subjective qualitative and objective quantitative comparison results, conducted on public datasets such as RoadScene, TNO, and MSRS, indicate that the visual quality and evaluation metrics of our fusion images are comparable to those achieved by the state-of-the-art image fusion methods.

Region-based Image Fusion Method Using Bidimensional Empirical Mode Decomposition.

Dual Band Image Fusion Method Based on Region Saliency

Region-aware RGB and Near-Infrared Image Fusion

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Multi-scale pixel-based image fusion using multivariate empirical mode decomposition

A method of image fusion based on the two-dimensional empirical mode decomposition

Adaptive Decomposition Method for Multi-Modal Medical Image Fusion.

P–M equation based multiscale decomposition and its application to image fusion

Multi-scale infrared and visible image fusion framework based on dual partial differential equations

Equivariant Multi-Modality Image Fusion

New Insights into Multi-focus Image Fusion: A Fusion Method Based on Multi-dictionary Linear Sparse Representation and Region Fusion Model

Image Fusion Algorithm Using Multiwavelet Analysis

Image Fusion Using Multiscale Edge-Preserving Decomposition Based on Weighted Least Squares Filter

Infrared and Visual Image Fusion Via Iterative Quadtree Decomposition and Bézier Interpolation

MDDCMA: A Distributed Image Fusion Framework Based on Multiscale Dense Dilated Convolution and Coordinate Mean Attention

MDC-RHT: Multi-Modal Medical Image Fusion via Multi-Dimensional Dynamic Convolution and Residual Hybrid Transformer

A Regional Image Fusion Based on Similarity Characteristics

A Novel Precise Decomposition Method For Infrared And Visible Image Fusion

A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion

Image Fusion Using Balanced Multiwavelet Transform

A Novel Multiscale Transform Decomposition Based Multi-Focus Image Fusion Framework