Abstract:Medical image fusion of images obtained via different modes can expand the inherent information of original images, whereby the fused image has a superior ability to display details than the original sub-images, to facilitate diagnosis and treatment selection. In medical image fusion, an inherent challenge is to effectively combine the most useful information and image details without information loss. Despite the many methods that have been proposed, the effective retention and presentation of information proves challenging. Therefore, we proposed and evaluated a novel image fusion method based on the discrete stationary wavelet transform (DSWT) and radial basis function neural network (RBFNN). First, we analyze the details or feature information of two images to be processed by DSWT by using two-level decomposition to separate each image into seven parts, comprising both high-frequency and low-frequency sub-bands. Considering the gradient and energy attributes of the target, we substituted the pending parts in the same position in the two images by using the proposed enhanced RBFNN. The input, hidden, and output layers of the neural network comprised 8, 40, and 1 neuron(s), respectively. From the seven neural networks, we obtained seven fused parts. Finally, through inverse wavelet transform, we obtained the final fused image. For the neural network training method, the hybrid adaptive gradient descent algorithm (AGDA) and gravitational search algorithm (GSA) were implemented. The final experimental results revealed that the novel method has significantly better performance than the current state-of-the-art methods.

Medical Image Fusion Using the PCNN Based on IQPSO in NSST Domain

Image Fusion of CT and MR with Sparse Representation in NSST Domain

Fusion Of Infrared And Visible Light Images Based On Nonsubsampled Shearlet Transform

Medical Image Fusion with Parameter-Adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain

Medical Image Fusion Method Based on Coupled Neural P Systems in Nonsubsampled Shearlet Transform Domain

Multi-modal medical image fusion using improved dual-channel PCNN

Feature-Motivated Simplified Adaptive PCNN-Based Medical Image Fusion Algorithm in NSST Domain

Multimodal medical image fusion with convolution sparse representation and mutual information correlation in NSST domain

Multimodal medical image fusion algorithm based on pulse coupled neural networks and nonsubsampled contourlet transform

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

A Medical Image Fusion Method Based on SIFT and Deep Convolutional Neural Network in the SIST Domain

Multimodal medical image fusion in NSST domain with structural and spectral features enhancement

Pulse Coupled Neural Network-Based Multimodal Medical Image Fusion via Guided Filtering and WSEML in NSCT Domain

Medical image fusion via discrete stationary wavelet transform and an enhanced radial basis function neural network

An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain

A novel fusion method based on dynamic threshold neural P systems and nonsubsampled contourlet transform for multi-modality medical images

Fusion of Infrared and Visible Light Images Based on Improved Adaptive Dual-Channel Pulse Coupled Neural Network

A Medical Image Fusion Method Based on Convolutional Neural Networks

Medical image fusion via discrete wavelet transform and fuzzy radial basis function neural network

Research of Multimodal Medical Image Fusion Based on Parameter-Adaptive Pulse-Coupled Neural Network and Convolutional Sparse Representation

A novel approach for multi-focus image fusion based on SF-PAPCNN and ISML in NSST domain