Abstract:The visible image contains many high-frequency components that provide texture details with high spatial resolution and definition consistent with human visual perception, but it is easily affected by external factors such as light, weather, and obstructions. On the other hand, the infrared image is a radiation image whose contrast is determined by the temperature difference between the target and the background and is not easily affected by external conditions. Integrating complementary information from both image types into one image is therefore very useful. In our article, we propose a dual-frequency cross-enhanced fusion network called DCFusion for infrared and visible image fusion. We design a frequency decomposition module and a frequency enhancement module based on Laplacian of Gaussian (LoG) for feature decomposition and enhancement, respectively. We then build a dual-frequency cross-enhanced fusion generator network based on these two modules to achieve enhanced fusion. We also use the sum of visible and infrared discriminator and the visible discriminator to balance our fusion results, replacing the traditional single visible discriminator. Our method is an end-to-end model, avoiding the manual design of complex fusion rules like traditional methods. Compared with existing advanced fusion algorithms, our method outperforms most of them in qualitative comparison, quantitative comparison, and target detection accuracy. Finally, the experiment proves that our method can effectively enhance the fusion of the target scene even in harsh environments such as complex lighting, low illumination, and smoke scenes.

Infrared-visible Image Fusion Using Accelerated Convergent Convolutional Dictionary Learning

A Fusion Algorithm for Infrared and Visible Images Based on Dictionary Learning and NSST

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Infrared And Visible Image Fusion Based On Convolutional Sparse Representation And Guided Filtering

Infrared and Visible Image Fusion with Convolutional Neural Networks.

Fusion of Infrared and Visible Images Using Fast Global Smoothing Decomposition and Target-Enhanced Parallel Gaussian Fuzzy Logic.

DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion.

An Infrared and Visible Image Fusion Framework Based on Dual Scale Decomposition and Learnable Attention Fusion Strategy

Infrared and Visible Image Fusion with Supervised Convolutional Neural Network

Visible and Infrared Image Fusion Based on Attention and Multiscale Residuals

DSFusion : Infrared and Visible Image Fusion Method Combining Detail and Scene Information

Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction

Infrared and Visible Image Fusion Via Rolling Guidance Filter and Convolutional Sparse Representation

An infrared and visible image fusion method based on deep learning

DTFusion: Infrared and Visible Image Fusion Based on Dense Residual PConv-ConvNeXt and Texture-Contrast Compensation

Infrared and Visible Image Fusion Based on Filtering Enhancement

A Deep Learning Framework for Infrared and Visible Image Fusion Without Strict Registration

Gated Fusion of Infrared and Visible Light Images Based on CNN

Adaptive Enhanced Infrared and Visible Image Fusion Using Hybrid Decomposition and Coupled Dictionary

Interactive residual coordinate attention and contrastive learning for infrared and visible image fusion in triple frequency bands