A densely interconnected network for deep learning accelerated MRI

Jon André Ottesen,Matthan W. A. Caan,Inge Rasmus Groote,Atle Bjørnerud

DOI: https://doi.org/10.1007/s10334-022-01041-3

2022-09-15

Abstract:To improve accelerated MRI reconstruction through a densely connected cascading deep learning reconstruction framework.

What problem does this paper attempt to address?

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

Yanfei Guo,Shi-Chun Chen,Zhao Li,Manuel Taso,David C. Alsop,Weiying Dai

DOI: https://doi.org/10.58530/2022/4048

2023-01-01

Abstract:Compressed sensing allowed speeding up MRI image acquisition by several folds but with increased reconstruction time. Deep-learning was introduced for fast reconstruction with comparable or improved reconstruction quality. However, its applications on non-cartesian grids are scarce, mostly based on simulated resampling from original Cartesian grids. Here, we evaluated the performance of two deep-learning networks for reconstructing images acquired with k-space spiral trajectories in real MRI scanning. We demonstrated that deep learning networks can successfully reconstruct high-resolution images from under-sampled spiral trajectories with half of data in k-space and their performance is robust to spiral trajectories different from training.
Parallel Imaging and Convolutional Neural Network Combined Fast MR Image Reconstruction: Applications in Low-Latency Accelerated Real-Time Imaging.

Ziwu Zhou,Fei Han,Vahid Ghodrati,Yu Gao,Wotao Yin,Yingli Yang,Peng Hu

DOI: https://doi.org/10.1002/mp.13628

2019-01-01

Abstract:Purpose To develop and evaluate a parallel imaging and convolutional neural network combined image reconstruction framework for low-latency and high-quality accelerated real-time MR imaging. Methods Conventional Parallel Imaging reconstruction resolved as gradient descent steps was compacted as network layers and interleaved with convolutional layers in a general convolutional neural network. All parameters of the network were determined during the offline training process, and applied to unseen data once learned. The proposed network was first evaluated for real-time cardiac imaging at 1.5 T and real-time abdominal imaging at 0.35 T, using threefold to fivefold retrospective undersampling for cardiac imaging and threefold retrospective undersampling for abdominal imaging. Then, prospective undersampling with fourfold acceleration was performed on cardiac imaging to compare the proposed method with standard clinically available GRAPPA method and the state-of-the-art L1-ESPIRiT method. Results Both retrospective and prospective evaluations confirmed that the proposed network was able to images with a lower noise level and reduced aliasing artifacts in comparison with the single-coil based and L1-ESPIRiT reconstructions for cardiac imaging at 1.5 T, and the GRAPPA and L1-ESPIRiT reconstructions for abdominal imaging at 0.35 T. Using the proposed method, each frame can be reconstructed in less than 100 ms, suggesting its clinical compatibility. Conclusion The proposed Parallel Imaging and convolutional neural network combined reconstruction framework is a promising technique that allows low-latency and high-quality real-time MR imaging.
Deep MRI Reconstruction: Unrolled Optimization Algorithms Meet Neural Networks

Dong Liang,Jing Cheng,Ziwen Ke,Leslie Ying

DOI: https://doi.org/10.48550/arXiv.1907.11711

2019-07-26

Abstract:Image reconstruction from undersampled k-space data has been playing an important role for fast MRI. Recently, deep learning has demonstrated tremendous success in various fields and also shown potential to significantly speed up MR reconstruction with reduced measurements. This article gives an overview of deep learning-based image reconstruction methods for MRI. Three types of deep learning-based approaches are reviewed, the data-driven, model-driven and integrated approaches. The main structure of each network in three approaches is explained and the analysis of common parts of reviewed networks and differences in-between are highlighted. Based on the review, a number of signal processing issues are discussed for maximizing the potential of deep reconstruction for fast MRI. the discussion may facilitate further development of "optimal" network and performance analysis from a theoretical point of view.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Signal Processing,Medical Physics
Accelerating Magnetic Resonance Imaging Via Deep Learning.

Shanshan Wang,Zhenghang Su,Leslie Ying,Xi Peng,Shun Zhu,Feng Liang,Dagan Feng,Dong Liang

DOI: https://doi.org/10.1109/isbi.2016.7493320

2016-01-01

Abstract:This paper proposes a deep learning approach for accelerating magnetic resonance imaging (MRI) using a large number of existing high quality MR images as the training datasets. An off-line convolutional neural network is designed and trained to identify the mapping relationship between the MR images obtained from zero-filled and fully-sampled k-space data. The network is not only capable of restoring fine structures and details but is also compatible with online constrained reconstruction methods. Experimental results on real MR data have shown encouraging performance of the proposed method for efficient and accurate imaging.
Enhanced MRI Reconstruction Network using Neural Architecture Search

Qiaoying Huang,Dong Yang,Yikun Xian,Pengxiang Wu,Jingru Yi,Hui Qu,Dimitris Metaxas

DOI: https://doi.org/10.48550/arXiv.2008.08248

2020-08-19

Abstract:The accurate reconstruction of under-sampled magnetic resonance imaging (MRI) data using modern deep learning technology, requires significant effort to design the necessary complex neural network architectures. The cascaded network architecture for MRI reconstruction has been widely used, while it suffers from the "vanishing gradient" problem when the network becomes deep. In addition, homogeneous architecture degrades the representation capacity of the network. In this work, we present an enhanced MRI reconstruction network using a residual in residual basic block. For each cell in the basic block, we use the differentiable neural architecture search (NAS) technique to automatically choose the optimal operation among eight variants of the dense block. This new heterogeneous network is evaluated on two publicly available datasets and outperforms all current state-of-the-art methods, which demonstrates the effectiveness of our proposed method.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
One-dimensional Deep Low-rank and Sparse Network for Accelerated MRI

Zi Wang,Chen Qian,Di Guo,Hongwei Sun,Rushuai Li,Bo Zhao,Xiaobo Qu

DOI: https://doi.org/10.48550/arXiv.2112.04721

2021-12-09

Abstract:Deep learning has shown astonishing performance in accelerated magnetic resonance imaging (MRI). Most state-of-the-art deep learning reconstructions adopt the powerful convolutional neural network and perform 2D convolution since many magnetic resonance images or their corresponding k-space are in 2D. In this work, we present a new approach that explores the 1D convolution, making the deep network much easier to be trained and generalized. We further integrate the 1D convolution into the proposed deep network, named as One-dimensional Deep Low-rank and Sparse network (ODLS), which unrolls the iteration procedure of a low-rank and sparse reconstruction model. Extensive results on in vivo knee and brain datasets demonstrate that, the proposed ODLS is very suitable for the case of limited training subjects and provides improved reconstruction performance than state-of-the-art methods both visually and quantitatively. Additionally, ODLS also shows nice robustness to different undersampling scenarios and some mismatches between the training and test data. In summary, our work demonstrates that the 1D deep learning scheme is memory-efficient and robust in fast MRI.

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition,Medical Physics
CDF-Net: Cross-Domain Fusion Network for Accelerated MRI Reconstruction

Osvald Nitski,Sayan Nag,Chris McIntosh,Bo Wang

DOI: https://doi.org/10.1007/978-3-030-59713-9_41

2020-01-01

Abstract:Accurate reconstruction of accelerated Magnetic Resonance Imaging (MRI) would produce myriad clinical benefits including higher patient throughput and lower examination cost. Traditional approaches utilize statistical methods in the frequency domain combined with Inverse Discrete Fourier Transform (IDFT) to interpolate the under-sampled frequency domain (referred as k-space) and often result in large artifacts in spatial domain. Recent advances in deep learning-based methods for MRI reconstruction, albeit outperforming traditional methods, fail to incorporate raw coil data and spatial domain data in an end-to-end manner. In this paper, we introduce a cross-domain fusion network (CDF-Net), a neural network architecture that recreates high resolution MRI reconstructions from an under-sampled single-coil k-space by taking advantage of relationships in both the frequency and spatial domains while also having an awareness of which frequencies have been omitted. CDF-Net consists of three main components, a U-Net variant operating on the spatial domain, another U-Net performing inpainting in k-space, and a ‘frequency informed’ U-Net variant merging the two reconstructions as well as a skip connected zero-filled reconstruction. The proposed CDF-Net represents one of the first end-to-end MRI reconstruction network that leverages relationships in both k-space and the spatial domain with a novel ‘frequency information pathway’ that allows information about missing frequencies to flow into the spatial domain. Trained on the largest public fastMRI dataset, CDF-Net outperforms both traditional statistical interpolation and deep learning-based methods by a large margin.
A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction

Jo Schlemper,Jose Caballero,Joseph V. Hajnal,Anthony Price,Daniel Rueckert

DOI: https://doi.org/10.48550/arXiv.1703.00555

2017-03-02

Abstract:The acquisition of Magnetic Resonance Imaging (MRI) is inherently slow. Inspired by recent advances in deep learning, we propose a framework for reconstructing MR images from undersampled data using a deep cascade of convolutional neural networks to accelerate the data acquisition process. We show that for Cartesian undersampling of 2D cardiac MR images, the proposed method outperforms the state-of-the-art compressed sensing approaches, such as dictionary learning-based MRI (DLMRI) reconstruction, in terms of reconstruction error, perceptual quality and reconstruction speed for both 3-fold and 6-fold undersampling. Compared to DLMRI, the error produced by the method proposed is approximately twice as small, allowing to preserve anatomical structures more faithfully. Using our method, each image can be reconstructed in 23 ms, which is fast enough to enable real-time applications.

Computer Vision and Pattern Recognition
Deep Magnetic Resonance Image Reconstruction: Inverse Problems Meet Neural Networks

Dong Liang,Jing Cheng,Ziwen Ke,Leslie Ying

DOI: https://doi.org/10.1109/msp.2019.2950557

IF: 15.204

2020-01-01

IEEE Signal Processing Magazine

Abstract:Image reconstruction from undersampled k-space data has been playing an important role in fast magnetic resonance imaging (MRI). Recently, deep learning has demonstrated tremendous success in various fields and also shown potential in significantly accelerating MRI reconstruction with fewer measurements. This article provides an overview of deep-learning-based image reconstruction methods for MRI. Two types of deep-learningbased approaches are reviewed, those that are based on unrolled algorithms and those that are not, and the main structures of both are explained. Several signal processing issues for maximizing the potential of deep reconstruction in fast MRI are discussed, which may facilitate further development of the networks and performance analysis from a theoretical point of view.

engineering, electrical & electronic
Assessment of data consistency through cascades of independently recurrent inference machines for fast and robust accelerated MRI reconstruction

Dimitrios Karkalousos,Samantha Noteboom,Hanneke E Hulst,Frans M Vos,Matthan W A Caan

DOI: https://doi.org/10.1088/1361-6560/ac6cc2

IF: 3.5

2022-05-05

Physics in Medicine and Biology

Abstract:Objective: Machine Learning methods can learn how to reconstruct Magnetic Resonance Images (MRI) and thereby accelerate acquisition, which is of paramount importance to the clinical workflow. Physics-informed networks incorporate the forward model of accelerated MRI reconstruction in the learning process. With increasing network complexity, robustness is not ensured when reconstructing data unseen during training. We aim to embed data consistency (DC) in deep networks while balancing the degree of network complexity. While doing so, we will assess whether either explicit or implicit enforcement of DC in varying network architectures is preferred to optimize performance. Approach: We propose a scheme called Cascades of Independently Recurrent Inference Machines (CIRIM) to assess DC through unrolled optimization. Herein we assess DC both implicitly by gradient descent and explicitly by a designed term. Extensive comparison of the CIRIM to Compressed Sensing as well as other Machine Learning methods is performed: the End-to-End Variational Network (E2EVN), CascadeNet, KIKINet, LPDNet, RIM, IRIM, and UNet. Models were trained and evaluated on T 1 -weighted and FLAIR contrast brain data, and T 2 -weighted knee data. Both 1D and 2D undersampling patterns were evaluated. Robustness was tested by reconstructing 7.5x prospectively undersampled 3D FLAIR MRI data of Multiple Sclerosis (MS) patients with white matter lesions. Main results: The CIRIM performed best when implicitly enforcing DC, while the E2EVN required an explicit DC formulation. Through its cascades, the CIRIM was able to score higher on Structural Similarity and PSNR compared to other methods, in particular under heterogeneous imaging conditions. In reconstructing MS patient data, prospectively acquired with a sampling pattern unseen during model training, the CIRIM maintained lesion contrast while efficiently denoising the images. Significance: The CIRIM showed highly promising generalization capabilities maintaining a very fair trade-off between reconstructed image quality and fast reconstruction times, which is crucial in the clinical workflow.

engineering, biomedical,radiology, nuclear medicine & medical imaging
Deep learning-based reconstruction of highly accelerated 3D MRI

Sangtae Ahn,Uri Wollner,Graeme McKinnon,Isabelle Heukensfeldt Jansen,Rafi Brada,Dan Rettmann,Ty A. Cashen,John Huston,J. Kevin DeMarco,Robert Y. Shih,Joshua D. Trzasko,Christopher J. Hardy,Thomas K. F. Foo

DOI: https://doi.org/10.48550/arxiv.2203.04674

2022-03-09

Image and Video Processing

Abstract:Purpose: To accelerate brain 3D MRI scans by using a deep learning method for reconstructing images from highly-undersampled multi-coil k-space data Methods: DL-Speed, an unrolled optimization architecture with dense skip-layer connections, was trained on 3D T1-weighted brain scan data to reconstruct complex-valued images from highly-undersampled k-space data. The trained model was evaluated on 3D MPRAGE brain scan data retrospectively-undersampled with a 10-fold acceleration, compared to a conventional parallel imaging method with a 2-fold acceleration. Scores of SNR, artifacts, gray/white matter contrast, resolution/sharpness, deep gray-matter, cerebellar vermis, anterior commissure, and overall quality, on a 5-point Likert scale, were assessed by experienced radiologists. In addition, the trained model was tested on retrospectively-undersampled 3D T1-weighted LAVA (Liver Acquisition with Volume Acceleration) abdominal scan data, and prospectively-undersampled 3D MPRAGE and LAVA scans in three healthy volunteers and one, respectively. Results: The qualitative scores for DL-Speed with a 10-fold acceleration were higher than or equal to those for the parallel imaging with 2-fold acceleration. DL-Speed outperformed a compressed sensing method in quantitative metrics on retrospectively-undersampled LAVA data. DL-Speed was demonstrated to perform reasonably well on prospectively-undersampled scan data, realizing a 2-5 times reduction in scan time. Conclusion: DL-Speed was shown to accelerate 3D MPRAGE and LAVA with up to a net 10-fold acceleration, achieving 2-5 times faster scans compared to conventional parallel imaging and acceleration, while maintaining diagnostic image quality and real-time reconstruction. The brain scan data-trained DL-Speed also performed well when reconstructing abdominal LAVA scan data, demonstrating versatility of the network.
Deep Residual Learning for Accelerated MRI using Magnitude and Phase Networks

Dongwook Lee,Jaejun Yoo,Sungho Tak,Jong Chul Ye

DOI: https://doi.org/10.48550/arXiv.1804.00432

2018-04-02

Abstract:Accelerated magnetic resonance (MR) scan acquisition with compressed sensing (CS) and parallel imaging is a powerful method to reduce MR imaging scan time. However, many reconstruction algorithms have high computational costs. To address this, we investigate deep residual learning networks to remove aliasing artifacts from artifact corrupted images. The proposed deep residual learning networks are composed of magnitude and phase networks that are separately trained. If both phase and magnitude information are available, the proposed algorithm can work as an iterative k-space interpolation algorithm using framelet representation. When only magnitude data is available, the proposed approach works as an image domain post-processing algorithm. Even with strong coherent aliasing artifacts, the proposed network successfully learned and removed the aliasing artifacts, whereas current parallel and CS reconstruction methods were unable to remove these artifacts. Comparisons using single and multiple coil show that the proposed residual network provides good reconstruction results with orders of magnitude faster computational time than existing compressed sensing methods. The proposed deep learning framework may have a great potential for accelerated MR reconstruction by generating accurate results immediately.

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning
Cascaded Dilated Dense Network with Two-step Data Consistency for MRI Reconstruction

Hao Zheng,Faming Fang,Guixu Zhang

2019-01-01

Abstract:Compressed Sensing MRI (CS-MRI) aims at reconstrcuting de-aliased images from sub-Nyquist sampling k-space data to accelerate MR Imaging. Inspired by recent deep learning methods, we propose a Cascaded Dilated Dense Network (CDDN) for MRI reconstruction. Dense blocks with residual connection are used to restore clear images step by step and dilated convolution is introduced for expanding receptive field without taking more network parameters. After each sub-network, we use a novel two-step Data Consistency (DC) operation in k-space. We convert the complex result from first DC operation to real-valued images and applied another sampled \emph{k}-space data replacement. Extensive experiments demonstrate that the proposed CDDN with two-step DC achieves state-of-art result.
Deep Network Cascade for Dynamic Cardiac MRI Reconstruction With Motion Feature Incorporation and the Fourier Neural Attention

Jingshuai Liu,Chen Qin,Mehrdad Yaghoobi

DOI: https://doi.org/10.1109/tci.2024.3402335

IF: 5.4

2024-05-30

IEEE Transactions on Computational Imaging

Abstract:Magnetic resonance imaging (MRI) provides a radiation-free and non-invasive tool for clinical diagnosis. However, it suffers from a prohibitively long acquisition process for many applications. Compressed sensing (CS) methods have been used for reconstruction from under-sampled data in accelerated acquisitions. Although effective in practice, the image quality can be limited by the expressiveness of handcrafted signal priors such as sparsity. Dynamic MRI requires high spatial and temporal resolution, which makes CS to be more difficult to recover the data taken within a short scanning time. In this paper, we explore to solve the challenging inverse problem by introducing an optimization-inspired deep leaning framework to recover dynamic MRI images. A novel mask-guided motion feature incorporation (Mask-MFI) scheme is proposed to benefit the recovery of the dynamic content, and a spatio-temporal Fourier neural block (ST-FNB) is designed to improve the reconstruction performance by leveraging the redundancies in spatial and temporal domains in a computation and parameter efficient manner. The comparative experiments demonstrate that the proposed framework outperforms other state-of-the-art methods at a range of accelerations both qualitatively and quantitatively. Ablation studies confirm the effectiveness of model components. Moreover, the adaptability and generalization capacity of the introduced method are also validated, which demonstrates the potential of the application of our proposed approach to other reconstruction models to boost their performance.

engineering, electrical & electronic,imaging science & photographic technology
A Deep Information Sharing Network for Multi-contrast Compressed Sensing MRI Reconstruction

Liyan Sun,Zhiwen Fan,Yue Huang,Xinghao Ding,John Paisley

DOI: https://doi.org/10.1109/TIP.2019.2925288

2018-04-10

Abstract:In multi-contrast magnetic resonance imaging (MRI), compressed sensing theory can accelerate imaging by sampling fewer measurements within each contrast. The conventional optimization-based models suffer several limitations: strict assumption of shared sparse support, time-consuming optimization and "shallow" models with difficulties in encoding the rich patterns hiding in massive MRI data. In this paper, we propose the first deep learning model for multi-contrast MRI reconstruction. We achieve information sharing through feature sharing units, which significantly reduces the number of parameters. The feature sharing unit is combined with a data fidelity unit to comprise an inference block. These inference blocks are cascaded with dense connections, which allows for information transmission across different depths of the network efficiently. Our extensive experiments on various multi-contrast MRI datasets show that proposed model outperforms both state-of-the-art single-contrast and multi-contrast MRI methods in accuracy and efficiency. We show the improved reconstruction quality can bring great benefits for the later medical image analysis stage. Furthermore, the robustness of the proposed model to the non-registration environment shows its potential in real MRI applications.

Computer Vision and Pattern Recognition
Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

Xiaohan Liu,Yanwei Pang,Xuebin Sun,Yiming Liu,Yonghong Hou,Zhenchang Wang,Xuelong Li

DOI: https://doi.org/10.1109/tip.2024.3388970

IF: 10.6

2024-04-27

IEEE Transactions on Image Processing

Abstract:High quality image reconstruction from undersampled -space data is key to accelerating MR scanning. Current deep learning methods are limited by the small receptive fields in reconstruction networks, which restrict the exploitation of long-range information, and impede the mitigation of full-image artifacts, particularly in 3D reconstruction tasks. Additionally, the substantial computational demands of 3D reconstruction considerably hinder advancements in related fields. To tackle these challenges, we propose the following: 1) A novel convolution operator named Faster Fourier Convolution (FasterFC), aims at providing an adaptable broad receptive field for spatial domain reconstruction networks with fast computational speed. 2) A split-slice strategy that substantially reduces the computational load of 3D reconstruction, enabling high-resolution, multi-coil, 3D MR image reconstruction while fully utilizing inter-layer and intra-layer information. 3) A single-to-group algorithm that efficiently utilizes scan-specific and data-driven priors to enhance -space interpolation effects. 4) A multi-stage, multi-coil, 3D fast MRI method, called the faster Fourier convolution based single-to-group network (FAS-Net), comprising a single-to-group -space interpolation algorithm and a FasterFC-based image domain reconstruction module, significantly minimizes the computational demands of 3D reconstruction through split-slice strategy. Experimental evaluations conducted on the NYU fastMRI and Stanford MRI Data datasets reveal that the FasterFC significantly enhances the quality of both 2D and 3D reconstruction results. Moreover, FAS-Net, characterized as a method that can achieve high-resolution (320, 320, 256), multi-coil, (8 coils), 3D fast MRI, exhibits superior reconstruction performance compared to other state-of-the-art 2D and 3D methods.

computer science, artificial intelligence,engineering, electrical & electronic
Deep learning within a priori temporal feature spaces for large-scale dynamic MR image reconstruction: Application to 5-D cardiac MR Multitasking

Yuhua Chen,Jaime L. Shaw,Yibin Xie,Debiao Li,Anthony G. Christodoulou

DOI: https://doi.org/10.48550/arXiv.1910.00956

2019-10-02

Image and Video Processing

Abstract:High spatiotemporal resolution dynamic magnetic resonance imaging (MRI) is a powerful clinical tool for imaging moving structures as well as to reveal and quantify other physical and physiological dynamics. The low speed of MRI necessitates acceleration methods such as deep learning reconstruction from under-sampled data. However, the massive size of many dynamic MRI problems prevents deep learning networks from directly exploiting global temporal relationships. In this work, we show that by applying deep neural networks inside a priori calculated temporal feature spaces, we enable deep learning reconstruction with global temporal modeling even for image sequences with >40,000 frames. One proposed variation of our approach using dilated multi-level Densely Connected Network (mDCN) speeds up feature space coordinate calculation by 3000x compared to conventional iterative methods, from 20 minutes to 0.39 seconds. Thus, the combination of low-rank tensor and deep learning models not only makes large-scale dynamic MRI feasible but also practical for routine clinical application.
Deep Convolutional Encoder-Decoder algorithm for MRI brain reconstruction

Ines Njeh,Hiba Mzoughi,Mohamed Ben Slima,Ahmed Ben Hamida,Chokri Mhiri,Kheireddine Ben Mahfoudh

DOI: https://doi.org/10.1007/s11517-020-02285-8

Abstract:Compressed Sensing Magnetic Resonance Imaging (CS-MRI) could be considered a challenged task since it could be designed as an efficient technique for fast MRI acquisition which could be highly beneficial for several clinical routines. In fact, it could grant better scan quality by reducing motion artifacts amount as well as the contrast washout effect. It offers also the possibility to reduce the exploration cost and the patient's anxiety. Recently, Deep Learning Neuronal Network (DL) has been suggested in order to reconstruct MRI scans with conserving the structural details and improving parallel imaging-based fast MRI. In this paper, we propose Deep Convolutional Encoder-Decoder architecture for CS-MRI reconstruction. Such architecture bridges the gap between the non-learning techniques, using data from only one image, and approaches using large training data. The proposed approach is based on autoencoder architecture divided into two parts: an encoder and a decoder. The encoder as well as the decoder has essentially three convolutional blocks. The proposed architecture has been evaluated through two databases: Hammersmith dataset (for the normal scans) and MICCAI 2018 (for pathological MRI). Moreover, we extend our model to cope with noisy pathological MRI scans. The normalized mean square error (NMSE), the peak-to-noise ratio (PSNR), and the structural similarity index (SSIM) have been adopted as evaluation metrics in order to evaluate the proposed architecture performance and to make a comparative study with the state-of-the-art reconstruction algorithms. The higher PSNR and SSIM values as well as the lowest NMSE values could attest that the proposed architecture offers better reconstruction and preserves textural image details. Furthermore, the running time is about 0.8 s, which is suitable for real-time processing. Such results could encourage the neurologist to adopt it in their clinical routines. Graphical abstract.
HFF-Net: A High-Frequency Fidelity Model for Accelerated Parallel MRI Reconstruction

Zhenggang Yang,Faming Fang,Qiaosi Yi,Guixu Zhang,Fang Li

DOI: https://doi.org/10.1109/icme57554.2024.10687808

2024-01-01

Abstract:Magnetic Resonance Imaging (MRI) plays a crucial role in diagnosing and treating various diseases. However, the long acquisition time of MRI scans often leads to patient discomfort and motion artifacts. Consequently, accelerating MRI speed is essential. Researchers have combined Deep Learning with Compressed Sensing and Parallel Imaging to advance MRI. However, many existing methods fail to effectively recover the fine details and structures in Magnetic Resonance images. To address these challenges, we propose a novel model for accelerated parallel MRI reconstruction. Our model incorporates a high-frequency fidelity method into the reconstruction process, explicitly emphasizing the recovery of high-frequency information. Additionally, we consider the joint priori distribution between the reconstructed images from each coil. Using the variable splitting approach, the proposed model is unrolled as an end-to-end network termed HFF-Net. Experimental results demonstrate that our method outperforms state-of-the-art techniques, yielding high-quality MR images with enhanced detail and fine structure recovery.
Deep-Learning Methods for Parallel Magnetic Resonance Imaging Reconstruction: A Survey of the Current Approaches, Trends, and Issues

Florian Knoll,Kerstin Hammernik,Chi Zhang,Steen Moeller,Thomas Pock,Daniel K Sodickson,Mehmet Akçakaya

DOI: https://doi.org/10.1109/MSP.2019.2950640

Abstract:Following the success of deep learning in a wide range of applications, neural network-based machine learning techniques have received interest as a means of accelerating magnetic resonance imaging (MRI). A number of ideas inspired by deep learning techniques from computer vision and image processing have been successfully applied to non-linear image reconstruction in the spirit of compressed sensing for both low dose computed tomography and accelerated MRI. The additional integration of multi-coil information to recover missing k-space lines in the MRI reconstruction process, is still studied less frequently, even though it is the de-facto standard for currently used accelerated MR acquisitions. This manuscript provides an overview of the recent machine learning approaches that have been proposed specifically for improving parallel imaging. A general background introduction to parallel MRI is given that is structured around the classical view of image space and k-space based methods. Both linear and non-linear methods are covered, followed by a discussion of recent efforts to further improve parallel imaging using machine learning, and specifically using artificial neural networks. Image-domain based techniques that introduce improved regularizers are covered as well as k-space based methods, where the focus is on better interpolation strategies using neural networks. Issues and open problems are discussed as well as recent efforts for producing open datasets and benchmarks for the community.

A densely interconnected network for deep learning accelerated MRI

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

Parallel Imaging and Convolutional Neural Network Combined Fast MR Image Reconstruction: Applications in Low-Latency Accelerated Real-Time Imaging.

Deep MRI Reconstruction: Unrolled Optimization Algorithms Meet Neural Networks

Accelerating Magnetic Resonance Imaging Via Deep Learning.

Enhanced MRI Reconstruction Network using Neural Architecture Search

One-dimensional Deep Low-rank and Sparse Network for Accelerated MRI

CDF-Net: Cross-Domain Fusion Network for Accelerated MRI Reconstruction

A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction

Deep Magnetic Resonance Image Reconstruction: Inverse Problems Meet Neural Networks

Assessment of data consistency through cascades of independently recurrent inference machines for fast and robust accelerated MRI reconstruction

Deep learning-based reconstruction of highly accelerated 3D MRI

Deep Residual Learning for Accelerated MRI using Magnitude and Phase Networks

Cascaded Dilated Dense Network with Two-step Data Consistency for MRI Reconstruction

Deep Network Cascade for Dynamic Cardiac MRI Reconstruction With Motion Feature Incorporation and the Fourier Neural Attention

A Deep Information Sharing Network for Multi-contrast Compressed Sensing MRI Reconstruction

Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

Deep learning within a priori temporal feature spaces for large-scale dynamic MR image reconstruction: Application to 5-D cardiac MR Multitasking

Deep Convolutional Encoder-Decoder algorithm for MRI brain reconstruction

HFF-Net: A High-Frequency Fidelity Model for Accelerated Parallel MRI Reconstruction

Deep-Learning Methods for Parallel Magnetic Resonance Imaging Reconstruction: A Survey of the Current Approaches, Trends, and Issues