Abstract:Background: Compressed sensing has been employed to accelerate magnetic resonance imaging by sampling fewer measurements. However, conventional iterative optimization-based CS-MRI are time-consuming for iterative calculations and often share poor generalization ability on multicontrast datasets. Most deep-learning-based CS-MRI focus on learning an end-to-end mapping while ignoring some prior knowledge existed in MR images. Purpose: We propose an iterative fusion model to integrate the image and gradient-based priors into reconstruction via convolutional neural network models while maintaining high quality and preserving the detailed information as well. Methods: We propose a gradient-enhanced fusion network (GFN) for fast and accurate MRI reconstruction, in which dense blocks with dilated convolution and dense residual learnings are used to capture abundant features with fewer parameters. Meanwhile, decomposed gradient maps containing obvious structural information are introduced into the network to enhance the reconstructed images. Besides this, gradient-based priors along directions X and Y are exploited to learn adaptive tight frames for reconstructing the desired image contrast and edges by respective gradient fusion networks. After that, both image and gradient priors are fused in the proposed optimization model, in which we employ the l2 -norm to promote the sparsity of gradient priors. The proposed fusion model can effectively help to capture edge structures in the gradient images and to preserve more detailed information of MR images. Results: Experimental results demonstrate that the proposed method outperforms several CS-MRI methods in terms of peak signal-to-noise (PSNR), the structural similarity index (SSIM), and visualizations on three sampling masks with different rates. Noteworthy, to evaluate the generalization ability, the proposed model conducts cross-center training and testing experiments for all three modalities and shares more stable performance compared than other approaches. In addition, the proposed fusion model is applied to other comparable deep learning methods. The quantitative results show that the reconstruction results of these methods are obviously improved. Conclusions: The gradient-based priors reconstructed from GFNs can effectively enhance the edges and details of under-sampled data. The proposed fusion model integrates image and gradient priors using l2 -norm can effectively improve the generalization ability on multicontrast datasets reconstruction.

MRI Image Fusion Based on Optimized Dictionary Learning and Binary Map Refining in Gradient Domain

Joint medical image fusion, denoising and enhancement via discriminative low-rank sparse dictionaries learning

An Integrated Dictionary-Learning Entropy-Based Medical Image Fusion Framework

MRI/CT Fusion Based on Latent Low Rank Representation and Gradient Transfer

Joint sparse model with coupled dictionary for medical image fusion

Multimodal medical image fusion based on interval gradients and convolutional neural networks

CT and MRI Image Fusion Based on Multiscale Decomposition Method and Hybrid Approach.

Medical Image Fusion Based on Feature Extraction and Sparse Representation

MRI and PET/SPECT fusion with pseudo spatial frequency in local laplacian filter domain

Multimodality Medical Image Fusion Using Clustered Dictionary Learning in Non-Subsampled Shearlet Transform

[CT and MRI fusion based on generative adversarial network and convolutional neural networks under image enhancement].

Multimodal medical image fusion using gradient domain guided filter random walk and side window filtering in framelet domain

Multi-Modal Medical Image Fusion Based on Gradient Domain Guided Image Filter

Medical image fusion via discrete stationary wavelet transform and an enhanced radial basis function neural network

A Medical Image Fusion Method Based on Convolutional Neural Networks

Medical image fusion based on improved multi-scale morphology gradient-weighted local energy and visual saliency map

Multi-Modal Medical Image Fusion Based on FusionNet in YIQ Color Space

Multimodal medical image fusion and classification using deep learning techniques

Deep compressed sensing MRI via a gradient-enhanced fusion model

Medical Image Fusion Based on Variational and Nonlinear Structure Tensor

Adaptive convolutional sparsity with sub-band correlation in the NSCT domain for MRI image fusion