Abstract:Remote sensing image fusion can effectively solve the inherent contradiction between spatial resolution and spectral resolution of imaging systems. At present, the fusion methods of remote sensing images based on multi-scale transform usually set fusion rules according to local feature information and pulse-coupled neural network (PCNN), but there are problems such as single local feature, as fusion rule cannot effectively extract feature information, PCNN parameter setting is complex, and spatial correlation is poor. To this end, a fusion method of remote sensing images that combines low-level visual features and a parameter-adaptive dual-channel pulse-coupled neural network (PADCPCNN) in a non-subsampled shearlet transform (NSST) domain is proposed in this paper. In the low-frequency sub-band fusion process, a low-level visual feature fusion rule is constructed by combining three local features, local phase congruency, local abrupt measure, and local energy information to enhance the extraction ability of feature information. In the process of high-frequency sub-band fusion, the structure and parameters of the dual-channel pulse-coupled neural network (DCPCNN) are optimized, including: (1) the multi-scale morphological gradient is used as an external stimulus to enhance the spatial correlation of DCPCNN; and (2) implement parameter-adaptive representation according to the difference box-counting, the Otsu threshold, and the image intensity to solve the complexity of parameter setting. Five sets of remote sensing image data of different satellite platforms and ground objects are selected for experiments. The proposed method is compared with 16 other methods and evaluated from qualitative and quantitative aspects. The experimental results show that, compared with the average value of the sub-optimal method in the five sets of data, the proposed method is optimized by 0.006, 0.009, 0.009, 0.035, 0.037, 0.042, and 0.020, respectively, in the seven evaluation indexes of information entropy, mutual information, average gradient, spatial frequency, spectral distortion, ERGAS, and visual information fidelity, indicating that the proposed method has the best fusion effect.

A study on local sensor fusion of wireless sensor networks based on the neural network

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Multi-Sensors Data Tracking Fusion Based on a Neural Network Filter

Learn to Sense: A Meta-Learning-Based Sensing and Fusion Framework for Wireless Sensor Networks

Information Fusion Based on Self-organizing Incremental Neural Network

Sparse Long Short-Term Memory for Information Fusion in Wireless Sensor Networks

Research on the Method of Neural Network Modeling Based on FCM Algorithm and Its Application on Vision-based Sensors

A Novel AMSS-FFN for Underwater Multisource Localization Using Artificial Lateral Line.

PCNN Model Guided by Saliency Mechanism for Image Fusion in Transform Domain

Novel data fusion strategy based on Bayesian compressive sensing in cognitive WSN

A network security situational awareness model based on multi-source heterogeneous sensors

Decentralized Network Structure System for Multisensor Data Fusion Based on Neural Network

Multimedia data fusion method based on wireless sensor network in intelligent transportation system

Infrared dual-band image fusion with simplified pulse coupled neural network and visual saliency map in nonsubsampled shearlet transform domain

Multi-sensor fusion for underwater robot self-localization using PC/BC-DIM neural network

IFNet: Data-driven multisensor estimate fusion with unknown correlation in sensor measurement noises

A Bayesian CNN-based Fusion Framework of Sensor Fault Diagnosis

A Localization Algorithm Based on Coevolutionary Noise-Suppressing Newton Method for Wireless Sensor Network

A Remote Sensing Image Fusion Method Combining Low-Level Visual Features and Parameter-Adaptive Dual-Channel Pulse-Coupled Neural Network

Neural network image fusion with PCA preprocessing

A novel image fusion method based on SGNN