Abstract:Remote sensing image fusion can effectively solve the inherent contradiction between spatial resolution and spectral resolution of imaging systems. At present, the fusion methods of remote sensing images based on multi-scale transform usually set fusion rules according to local feature information and pulse-coupled neural network (PCNN), but there are problems such as single local feature, as fusion rule cannot effectively extract feature information, PCNN parameter setting is complex, and spatial correlation is poor. To this end, a fusion method of remote sensing images that combines low-level visual features and a parameter-adaptive dual-channel pulse-coupled neural network (PADCPCNN) in a non-subsampled shearlet transform (NSST) domain is proposed in this paper. In the low-frequency sub-band fusion process, a low-level visual feature fusion rule is constructed by combining three local features, local phase congruency, local abrupt measure, and local energy information to enhance the extraction ability of feature information. In the process of high-frequency sub-band fusion, the structure and parameters of the dual-channel pulse-coupled neural network (DCPCNN) are optimized, including: (1) the multi-scale morphological gradient is used as an external stimulus to enhance the spatial correlation of DCPCNN; and (2) implement parameter-adaptive representation according to the difference box-counting, the Otsu threshold, and the image intensity to solve the complexity of parameter setting. Five sets of remote sensing image data of different satellite platforms and ground objects are selected for experiments. The proposed method is compared with 16 other methods and evaluated from qualitative and quantitative aspects. The experimental results show that, compared with the average value of the sub-optimal method in the five sets of data, the proposed method is optimized by 0.006, 0.009, 0.009, 0.035, 0.037, 0.042, and 0.020, respectively, in the seven evaluation indexes of information entropy, mutual information, average gradient, spatial frequency, spectral distortion, ERGAS, and visual information fidelity, indicating that the proposed method has the best fusion effect.

Hyperspectral Image Quality Evaluation Based On Multi-Model Fusion

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

A Model for Resolving Images of Similar Quality Based on Data Application

Multispectral and hyperspectral image fusion via multi-model deep prior regularization

Comprehensive Evaluation for Fused Images of Multispectral and Panchromatic Images Based on Entropy Weight Method

Remote Sensing Image Fusion Based on Fuzzy Theory in Pixel Level and Assessing the Quality of Resulting Images

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

The Realistic Fusion of Multi-spectral Images

Multi‐domain pseudo‐reference quality evaluation for infrared and visible image fusion

Comparison of quality evaluation methods for image fusion of farmland remote sensing

Multi-source Remote Sensing Image Fusion Based on Support Vector Machine

Research on objective assessment of dual-band color night vision fusion image quality based on scene understanding

Hyperspectral-multispectral image fusion using subspace decomposition and Elastic Net Regularization

The Study of Methods of Quantitative Evaluation on Remote Sensing Image Fusion and Actualization

Multispectral and Hyperspectral Image Fusion Based on Regularized Coupled Non-Negative Block-Term Tensor Decomposition

A model-guided deep convolutional sparse coding network for hyperspectral and multispectral image fusion

Spectral-Spatial Residual Network for Fusing Hyperspectral and Panchromatic Remote Sensing Images

Deep Hyperspectral and Multispectral Image Fusion with Inter-image Variability

The Research on Comparing and Analyzing the Remote Sensing Image Fusion and Algorithm with High Spectral and Spatial Quality

Hyperspectral and Multispectral Image Fusion by Deep Neural Network in a Self-Supervised Manner

A Remote Sensing Image Fusion Method Combining Low-Level Visual Features and Parameter-Adaptive Dual-Channel Pulse-Coupled Neural Network