Abstract:The visible image contains many high-frequency components that provide texture details with high spatial resolution and definition consistent with human visual perception, but it is easily affected by external factors such as light, weather, and obstructions. On the other hand, the infrared image is a radiation image whose contrast is determined by the temperature difference between the target and the background and is not easily affected by external conditions. Integrating complementary information from both image types into one image is therefore very useful. In our article, we propose a dual-frequency cross-enhanced fusion network called DCFusion for infrared and visible image fusion. We design a frequency decomposition module and a frequency enhancement module based on Laplacian of Gaussian (LoG) for feature decomposition and enhancement, respectively. We then build a dual-frequency cross-enhanced fusion generator network based on these two modules to achieve enhanced fusion. We also use the sum of visible and infrared discriminator and the visible discriminator to balance our fusion results, replacing the traditional single visible discriminator. Our method is an end-to-end model, avoiding the manual design of complex fusion rules like traditional methods. Compared with existing advanced fusion algorithms, our method outperforms most of them in qualitative comparison, quantitative comparison, and target detection accuracy. Finally, the experiment proves that our method can effectively enhance the fusion of the target scene even in harsh environments such as complex lighting, low illumination, and smoke scenes.

Gated Fusion of Infrared and Visible Light Images Based on CNN

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Infrared and Visible Image Fusion with Supervised Convolutional Neural Network

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Infrared and Visible Image Fusion with Convolutional Neural Networks.

A Fusion Algorithm for Infrared and Visible Images Based on RDU-PCNN and ICA-bases in NSST Domain

HDCTfusion: Hybrid Dual-Branch Network Based on CNN and Transformer for Infrared and Visible Image Fusion

Infrared-visible Image Fusion Using Accelerated Convergent Convolutional Dictionary Learning

A Fusion Framework for Infrared and Visible Images Based on CNN and MST

DenseNetFuse: a study of deep unsupervised DenseNet to infrared and visual image fusion

DenseFuse: A Fusion Approach to Infrared and Visible Images

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

HDCCT: Hybrid Densely Connected CNN and Transformer for Infrared and Visible Image Fusion

DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion.

Fusion of infrared and visible light images for object detection based on CNN

Infrared visible color night vision image fusion based on deep learning

Dense-FG: A Fusion GAN Model by Using Densely Connected Blocks to Fuse Infrared and Visible Images

Infrared and Visible Image Fusion Based on Filtering Enhancement

Visible and Infrared Image Fusion Based on Attention and Multiscale Residuals

Infrared and Visible Image Fusion Using a Shallow CNN and Structural Similarity Constraint

Fusion of infrared and visible images based on adaptive PCNN and information extraction