Abstract:Infrared and visible image fusion can generate a fusion image with clear texture and prominent goals under extreme conditions. This capability is important for all-day climate detection and other tasks. However, most existing fusion methods for extracting features from infrared and visible images are based on convolutional neural networks (CNNs). These methods often fail to make full use of the salient objects and texture features in the raw image, leading to problems such as insufficient texture details and low contrast in the fused images. To this end, we propose an unsupervised end-to-end Fusion Decomposition Network (FDNet) for infrared and visible image fusion. Firstly, we construct a fusion network that extracts gradient and intensity information from raw images, using multi-scale layers, depthwise separable convolution, and improved convolution block attention module (I-CBAM). Secondly, as the FDNet network is based on the gradient and intensity information of the image for feature extraction, gradient and intensity loss are designed accordingly. Intensity loss adopts the improved Frobenius norm to adjust the weighing values between the fused image and the two raw to select more effective information. The gradient loss introduces an adaptive weight block that determines the optimized objective based on the richness of texture information at the pixel scale, ultimately guiding the fused image to generate more abundant texture information. Finally, we design a single and dual channel convolutional layer decomposition network, which keeps the decomposed image as possible with the input raw image, forcing the fused image to contain richer detail information. Compared with various other representative image fusion methods, our proposed method not only has good subjective vision, but also achieves advanced fusion performance in objective evaluation.

FDFNet: A Fusion Network for Generating High-Resolution Fully PolSAR Images

Fully Polarimetric SAR and Single-Polarization SAR Image Fusion Network

SDF2Net: Shallow to Deep Feature Fusion Network for PolSAR Image Classification

Terrain Segmentation in Polarimetric SAR Images Using Dual-Attention Fusion Network

Polar-Spatial Feature Fusion Learning With Variational Generative-Discriminative Network for PolSAR Classification

DAFCNN: A Dual-Channel Feature Extraction and Attention Feature Fusion Convolution Neural Network for SAR Image and MS Image Fusion

A Feature Fusion-Net Using Deep Spatial Context Encoder and Nonstationary Joint Statistical Model for High-Resolution SAR Image Classification

CDFNet:Cross-Domain Feature Fusion Network for PolSAR Terrain Classification

Multilevel Scattering Center and Deep Feature Fusion Learning Framework for SAR Target Recognition

Trusted Polarimetric Feature Fusion for Polsar Image Classification

Efficient Cloud Removal Network for Satellite Images Using SAR-Optical Image Fusion

MFFnet: Multimodal Feature Fusion Network for Synthetic Aperture Radar and Optical Image Land Cover Classification

Unsupervised Difference-Guided Adaptive Fusion Network for Change Detection in PolSAR Images

HI2D2FNet: Hyperspectral Intrinsic Image Decomposition Guided Data Fusion Network for Hyperspectral and LiDAR Classification

FEF-Net: A Deep Learning Approach to Multiview SAR Image Target Recognition

Hyperspectral Image Fusion Based on Dual-Resolution Fusion Feature Mutual Guidance Network

Dual-Branch Fusion of Convolutional Neural Network and Graph Convolutional Network for PolSAR Image Classification

SDCAFNet: A Deep Convolutional Neural Network for Land-Cover Semantic Segmentation with the Fusion of PolSAR and Optical Images.

FDNet: An end-to-end fusion decomposition network for infrared and visible images

Polarimetric SAR Feature Extraction with Neighborhood Preservation-Based Deep Learning

A New Parallel Dual-Channel Fully Convolutional Network Via Semi-Supervised FCM for PolSAR Image Classification.