Abstract:The pulse-coupled neural network (PCNN), due to its effectiveness in simulating the mammalian visual system to perceive and understand visual information, has been widely applied in the fields of image segmentation and image fusion. To address the issues of low contrast and the loss of detail information in infrared and visible light image fusion, this paper proposes a novel image fusion method based on an improved adaptive dual-channel PCNN model in the non-subsampled shearlet transform (NSST) domain. Firstly, NSST is used to decompose the infrared and visible light images into a series of high-pass sub-bands and a low-pass sub-band, respectively. Next, the PCNN models are stimulated using the weighted sum of the eight-neighborhood Laplacian of the high-pass sub-bands and the energy activity of the low-pass sub-band. The high-pass sub-bands are fused using local structural information as the basis for the linking strength for the PCNN, while the low-pass sub-band is fused using a linking strength based on multiscale morphological gradients. Finally, the fused high-pass and low-pass sub-bands are reconstructed to obtain the fused image. Comparative experiments demonstrate that, subjectively, this method effectively enhances the contrast of scenes and targets while preserving the detail information of the source images. Compared to the best mean values of the objective evaluation metrics of the compared methods, the proposed method shows improvements of 2.35%, 3.49%, and 11.60% in information entropy, mutual information, and standard deviation, respectively.

A Fusion Algorithm for Infrared and Visible Images Based on Dictionary Learning and NSST

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

Infrared and visible image fusion enhancement technology based on multi-scale directional analysis

Infrared and Visible Images Fusion Using Visual Saliency and Dual-PCNN

A novel image fusion algorithm for infrared and visible light

Infrared and Visible Image Fusion Based on NSCT and Fuzzy Logic

Fusion of Infrared and Visible Images Via Multi-Layer Convolutional Sparse Representation

Infrared-visible Image Fusion Using Accelerated Convergent Convolutional Dictionary Learning

Infrared and Visible Image Fusion Based on Saliency Detection Dynamic Threshold Neural P Systems in Non-Subsampled Shearlet Transform Domain

Infrared and Visible Image Fusion Using Intensity Transfer and Phase Congruency in Nonsubsampled Shearlet Transform Domain

Fusion of Low-Quality Visible and Infrared Images Based on Multi-Level Latent Low-Rank Representation Joint with Retinex Enhancement and Multi-Visual Weight Information

Infrared and visible image fusion based on domain transform filtering and sparse representation

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

An improved hybrid multiscale fusion algorithm based on NSST for infrared–visible images

FSADFuse: A Novel Fusion Approach to Infrared and Visible Images

Visible and Infrared Image Fusion Based on Attention and Multiscale Residuals

Infrared and Visible Image Fusion with Convolutional Neural Networks.

Infrared and Visible Image Fusion Based on NSCT and Stacked Sparse Autoencoders

Infrared and visible image fusion based on NSST and phase consistency adaptive DUAL channel PCNN