Abstract:The pulse-coupled neural network (PCNN), due to its effectiveness in simulating the mammalian visual system to perceive and understand visual information, has been widely applied in the fields of image segmentation and image fusion. To address the issues of low contrast and the loss of detail information in infrared and visible light image fusion, this paper proposes a novel image fusion method based on an improved adaptive dual-channel PCNN model in the non-subsampled shearlet transform (NSST) domain. Firstly, NSST is used to decompose the infrared and visible light images into a series of high-pass sub-bands and a low-pass sub-band, respectively. Next, the PCNN models are stimulated using the weighted sum of the eight-neighborhood Laplacian of the high-pass sub-bands and the energy activity of the low-pass sub-band. The high-pass sub-bands are fused using local structural information as the basis for the linking strength for the PCNN, while the low-pass sub-band is fused using a linking strength based on multiscale morphological gradients. Finally, the fused high-pass and low-pass sub-bands are reconstructed to obtain the fused image. Comparative experiments demonstrate that, subjectively, this method effectively enhances the contrast of scenes and targets while preserving the detail information of the source images. Compared to the best mean values of the objective evaluation metrics of the compared methods, the proposed method shows improvements of 2.35%, 3.49%, and 11.60% in information entropy, mutual information, and standard deviation, respectively.

Multifocus Image Fusion Scheme Based on Nonsubsampled Contourlet Transform

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Multi-focus image fusion approach based on CNP systems in NSCT domain

Multi-Focus Image Fusion via Distance-Weighted Regional Energy and Structure Tensor in NSCT Domain

Fractal Dimension-Based Multi-Focus Image Fusion via Coupled Neural P Systems in NSCT Domain

Multi-Focus Image Fusion via PAPCNN and Fractal Dimension in NSST Domain

A novel approach for multi-focus image fusion based on SF-PAPCNN and ISML in NSST domain

A New Method for Remote Sensing Image Fusion Based on Nonsubsampled Contourlet Transform

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

Image fusion based on nonsubsampled contourlet transform for infrared and visible light image

CCSR-Net: Unfolding Coupled Convolutional Sparse Representation for Multi-focus Image Fusion.

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

A Novel Multiscale Transform Decomposition Based Multi-Focus Image Fusion Framework

Multi-Focus Image Fusion Using U-Shaped Networks with a Hybrid Objective

An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain

Cooperative Fusion of Stationary Wavelet Transform and Non-Subsampled Contourlet for Multifocus Images

A General Memristor-Based Pulse Coupled Neural Network with Variable Linking Coefficient for Multi-Focus Image Fusion

Multispectral and Panchromatic Image Fusion Based on Unsubsampled Contourlet Transform

Infrared and visible image fusion enhancement technology based on multi-scale directional analysis