Abstract:The visible image contains many high-frequency components that provide texture details with high spatial resolution and definition consistent with human visual perception, but it is easily affected by external factors such as light, weather, and obstructions. On the other hand, the infrared image is a radiation image whose contrast is determined by the temperature difference between the target and the background and is not easily affected by external conditions. Integrating complementary information from both image types into one image is therefore very useful. In our article, we propose a dual-frequency cross-enhanced fusion network called DCFusion for infrared and visible image fusion. We design a frequency decomposition module and a frequency enhancement module based on Laplacian of Gaussian (LoG) for feature decomposition and enhancement, respectively. We then build a dual-frequency cross-enhanced fusion generator network based on these two modules to achieve enhanced fusion. We also use the sum of visible and infrared discriminator and the visible discriminator to balance our fusion results, replacing the traditional single visible discriminator. Our method is an end-to-end model, avoiding the manual design of complex fusion rules like traditional methods. Compared with existing advanced fusion algorithms, our method outperforms most of them in qualitative comparison, quantitative comparison, and target detection accuracy. Finally, the experiment proves that our method can effectively enhance the fusion of the target scene even in harsh environments such as complex lighting, low illumination, and smoke scenes.

Contrast-enhanced fusion of dual-band infrared image

Infrared and visible image fusion method based on saliency detection and target-enhancement

Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Dual Band Image Fusion Method Based on Region Saliency

Infrared and visual image fusion enhancement by dual-transform

Infrared and Visible Image Fusion Algorithm Based on Double-Domain Transform Filter and Contrast Transform Feature Extraction

An Image Fusion Algorithm Based on WA-WBA and Improved Non-subsampled Contourlet Transform

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Detail enhanced multi-source fusion using visual weight map extraction based on multi scale edge preserving decomposition

Infrared and visible image fusion based on edge-preserving filter and weighted least square optimization

Adaptive low light visual enhancement and high-significant target detection for infrared and visible image fusion

DCFusion: A Dual-Frequency Cross-Enhanced Fusion Network for Infrared and Visible Image Fusion.

Infrared and Visible Image Fusion Using Dual-Tree Complex Wavelet Transform and Convolutional Sparse Representation

Infrared and visible image fusion enhancement technology based on multi-scale directional analysis

Infrared and Visible Image Fusion Method Based on Hierarchical Attention Mechanism

Infrared and Visual Image Fusion Based on a Local-Extrema-Driven Image Filter

Infrared and Visual Image Fusion Through Infrared Feature Extraction and Visual Information Preservation

Infrared and Visible Images Fusion Using Visual Saliency and Dual-PCNN

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network