Fast and Accurate Reconstruction of Human Lung Gas MRI with Deep Learning

Caohui Duan,He Deng,Sa Xiao,Junshuai Xie,Haidong Li,Xianping Sun,Lin Ma,Xin Lou,Chaohui Ye,Xin Zhou

DOI: https://doi.org/10.1002/mrm.27889

2019-01-01

Magnetic Resonance in Medicine

Abstract:To fast and accurately reconstruct human lung gas MRI from highly undersampled k‐space using deep learning.

What problem does this paper attempt to address?

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

Yanfei Guo,Shi-Chun Chen,Zhao Li,Manuel Taso,David C. Alsop,Weiying Dai

DOI: https://doi.org/10.58530/2022/4048

2023-01-01

Abstract:Compressed sensing allowed speeding up MRI image acquisition by several folds but with increased reconstruction time. Deep-learning was introduced for fast reconstruction with comparable or improved reconstruction quality. However, its applications on non-cartesian grids are scarce, mostly based on simulated resampling from original Cartesian grids. Here, we evaluated the performance of two deep-learning networks for reconstructing images acquired with k-space spiral trajectories in real MRI scanning. We demonstrated that deep learning networks can successfully reconstruct high-resolution images from under-sampled spiral trajectories with half of data in k-space and their performance is robust to spiral trajectories different from training.
Deep 3D reconstruction of synchrotron X-ray computed tomography for intact lungs

Seungjoo Shin,Min Woo Kim,Kyong Hwan Jin,Kwang Moo Yi,Yoshiki Kohmura,Tetsuya Ishikawa,Jung Ho Je,Jaesik Park

DOI: https://doi.org/10.1038/s41598-023-27627-y

IF: 4.6

2023-02-01

Scientific Reports

Abstract:Synchrotron X-rays can be used to obtain highly detailed images of parts of the lung. However, micro-motion artifacts induced by such as cardiac motion impede quantitative visualization of the alveoli in the lungs. This paper proposes a method that applies a neural network for synchrotron X-ray Computed Tomography (CT) data to reconstruct the high-quality 3D structure of alveoli in intact mouse lungs at expiration, without needing ground-truth data. Our approach reconstructs the spatial sequence of CT images by using a deep-image prior with interpolated input latent variables, and in this way significantly enhances the images of alveolar structure compared with the prior art. The approach successfully visualizes 3D alveolar units of intact mouse lungs at expiration and enables us to measure the diameter of the alveoli. We believe that our approach helps to accurately visualize other living organs hampered by micro-motion.

multidisciplinary sciences
Accelerate gas diffusion-weighted MRI for lung morphometry with deep learning

Caohui Duan,He Deng,Sa Xiao,Junshuai Xie,Haidong Li,Xiuchao Zhao,Dongshan Han,Xianping Sun,Xin Lou,Chaohui Ye,Xin Zhou

DOI: https://doi.org/10.1007/s00330-021-08126-y

IF: 7.034

2021-07-13

European Radiology

Abstract:ObjectivesMultiple b-value gas diffusion-weighted MRI (DW-MRI) enables non-invasive and quantitative assessment of lung morphometry, but its long acquisition time is not well-tolerated by patients. We aimed to accelerate multiple b-value gas DW-MRI for lung morphometry using deep learning.MethodsA deep cascade of residual dense network (DC-RDN) was developed to reconstruct high-quality DW images from highly undersampled k-space data. Hyperpolarized 129Xe lung ventilation images were acquired from 101 participants and were retrospectively collected to generate synthetic DW-MRI data to train the DC-RDN. Afterwards, the performance of the DC-RDN was evaluated on retrospectively and prospectively undersampled multiple b-value 129Xe MRI datasets.ResultsEach slice with size of 64 × 64 × 5 could be reconstructed within 7.2 ms. For the retrospective test data, the DC-RDN showed significant improvement on all quantitative metrics compared with the conventional reconstruction methods (p < 0.05). The apparent diffusion coefficient (ADC) and morphometry parameters were not significantly different between the fully sampled and DC-RDN reconstructed images (p > 0.05). For the prospectively accelerated acquisition, the required breath-holding time was reduced from 17.8 to 4.7 s with an acceleration factor of 4. Meanwhile, the prospectively reconstructed results showed good agreement with the fully sampled images, with a mean difference of −0.72% and −0.74% regarding global mean ADC and mean linear intercept (Lm) values.ConclusionsDC-RDN is effective in accelerating multiple b-value gas DW-MRI while maintaining accurate estimation of lung microstructural morphometry, facilitating the clinical potential of studying lung diseases with hyperpolarized DW-MRI.Key Points• The deep cascade of residual dense network allowed fast and high-quality reconstruction of multiple b-value gas diffusion-weighted MRI at an acceleration factor of 4.• The apparent diffusion coefficient and morphometry parameters were not significantly different between the fully sampled images and the reconstructed results (p > 0.05).• The required breath-holding time was reduced from 17.8 to 4.7 s and each slice with size of 64 × 64 × 5 could be reconstructed within 7.2 ms.

radiology, nuclear medicine & medical imaging
Encoding Enhanced Complex CNN for Accurate and Highly Accelerated MRI

Zimeng Li,Sa Xiao,Cheng Wang,Haidong Li,Xiuchao Zhao,Caohui Duan,Qian Zhou,Qiuchen Rao,Yuan Fang,Junshuai Xie,Lei Shi,Fumin Guo,Chaohui Ye,Xin Zhou

2023-11-13

Abstract:Magnetic resonance imaging (MRI) using hyperpolarized noble gases provides a way to visualize the structure and function of human lung, but the long imaging time limits its broad research and clinical applications. Deep learning has demonstrated great potential for accelerating MRI by reconstructing images from undersampled data. However, most existing deep conventional neural networks (CNN) directly apply square convolution to k-space data without considering the inherent properties of k-space sampling, limiting k-space learning efficiency and image reconstruction quality. In this work, we propose an encoding enhanced (EN2) complex CNN for highly undersampled pulmonary MRI reconstruction. EN2 employs convolution along either the frequency or phase-encoding direction, resembling the mechanisms of k-space sampling, to maximize the utilization of the encoding correlation and integrity within a row or column of k-space. We also employ complex convolution to learn rich representations from the complex k-space data. In addition, we develop a feature-strengthened modularized unit to further boost the reconstruction performance. Experiments demonstrate that our approach can accurately reconstruct hyperpolarized 129Xe and 1H lung MRI from 6-fold undersampled k-space data and provide lung function measurements with minimal biases compared with fully-sampled image. These results demonstrate the effectiveness of the proposed algorithmic components and indicate that the proposed approach could be used for accelerated pulmonary MRI in research and clinical lung disease patient care.

Image and Video Processing,Computer Vision and Pattern Recognition
Deep Reconstruction Model For Dynamic Pet Images

Jianan Cui,Xin Liu,Yile Wang,Huafeng Liu

DOI: https://doi.org/10.1371/journal.pone.0184667

IF: 3.7

2017-01-01

PLoS ONE

Abstract:Accurate and robust tomographic reconstruction from dynamic positron emission tomography (PET) acquired data is a difficult problem. Conventional methods, such as the maximum likelihood expectation maximization (MLEM) algorithm for reconstructing the activity distribution-based on individual frames, may lead to inaccurate results due to the checkerboard effect and limitation of photon counts. In this paper, we propose a stacked sparse auto-encoder based reconstruction framework for dynamic PET imaging. The dynamic reconstruction problem is formulated in a deep learning representation, where the encoding layers extract the prototype features, such as edges, so that, in the decoding layers, the reconstructed results are obtained through a combination of those features. The qualitative and quantitative results of the procedure, including the data based on a Monte Carlo simulation and real patient data demonstrates the effectiveness of our method.
Accelerating Magnetic Resonance Imaging Via Deep Learning.

Shanshan Wang,Zhenghang Su,Leslie Ying,Xi Peng,Shun Zhu,Feng Liang,Dagan Feng,Dong Liang

DOI: https://doi.org/10.1109/isbi.2016.7493320

2016-01-01

Abstract:This paper proposes a deep learning approach for accelerating magnetic resonance imaging (MRI) using a large number of existing high quality MR images as the training datasets. An off-line convolutional neural network is designed and trained to identify the mapping relationship between the MR images obtained from zero-filled and fully-sampled k-space data. The network is not only capable of restoring fine structures and details but is also compatible with online constrained reconstruction methods. Experimental results on real MR data have shown encouraging performance of the proposed method for efficient and accurate imaging.
Deep learning for fast MR imaging: a review for learning reconstruction from incomplete k-space data

Shanshan Wang,Taohui Xiao,Qiegen Liu,Hairong Zheng

DOI: https://doi.org/10.48550/arXiv.2012.08931

2020-12-15

Abstract:Magnetic resonance imaging is a powerful imaging modality that can provide versatile information but it has a bottleneck problem "slow imaging speed". Reducing the scanned measurements can accelerate MR imaging with the aid of powerful reconstruction methods, which have evolved from linear analytic models to nonlinear iterative ones. The emerging trend in this area is replacing human-defined signal models with that learned from data. Specifically, from 2016, deep learning has been incorporated into the fast MR imaging task, which draws valuable prior knowledge from big datasets to facilitate accurate MR image reconstruction from limited measurements. This survey aims to review deep learning based MR image reconstruction works from 2016- June 2020 and will discuss merits, limitations and challenges associated with such methods. Last but not least, this paper will provide a starting point for researchers interested in contributing to this field by pointing out good tutorial resources, state-of-the-art open-source codes and meaningful data sources.

Image and Video Processing
Deep learning-based reconstruction of highly accelerated 3D MRI

Sangtae Ahn,Uri Wollner,Graeme McKinnon,Isabelle Heukensfeldt Jansen,Rafi Brada,Dan Rettmann,Ty A. Cashen,John Huston,J. Kevin DeMarco,Robert Y. Shih,Joshua D. Trzasko,Christopher J. Hardy,Thomas K. F. Foo

DOI: https://doi.org/10.48550/arxiv.2203.04674

2022-03-09

Image and Video Processing

Abstract:Purpose: To accelerate brain 3D MRI scans by using a deep learning method for reconstructing images from highly-undersampled multi-coil k-space data Methods: DL-Speed, an unrolled optimization architecture with dense skip-layer connections, was trained on 3D T1-weighted brain scan data to reconstruct complex-valued images from highly-undersampled k-space data. The trained model was evaluated on 3D MPRAGE brain scan data retrospectively-undersampled with a 10-fold acceleration, compared to a conventional parallel imaging method with a 2-fold acceleration. Scores of SNR, artifacts, gray/white matter contrast, resolution/sharpness, deep gray-matter, cerebellar vermis, anterior commissure, and overall quality, on a 5-point Likert scale, were assessed by experienced radiologists. In addition, the trained model was tested on retrospectively-undersampled 3D T1-weighted LAVA (Liver Acquisition with Volume Acceleration) abdominal scan data, and prospectively-undersampled 3D MPRAGE and LAVA scans in three healthy volunteers and one, respectively. Results: The qualitative scores for DL-Speed with a 10-fold acceleration were higher than or equal to those for the parallel imaging with 2-fold acceleration. DL-Speed outperformed a compressed sensing method in quantitative metrics on retrospectively-undersampled LAVA data. DL-Speed was demonstrated to perform reasonably well on prospectively-undersampled scan data, realizing a 2-5 times reduction in scan time. Conclusion: DL-Speed was shown to accelerate 3D MPRAGE and LAVA with up to a net 10-fold acceleration, achieving 2-5 times faster scans compared to conventional parallel imaging and acceleration, while maintaining diagnostic image quality and real-time reconstruction. The brain scan data-trained DL-Speed also performed well when reconstructing abdominal LAVA scan data, demonstrating versatility of the network.
Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

Xiaohan Liu,Yanwei Pang,Xuebin Sun,Yiming Liu,Yonghong Hou,Zhenchang Wang,Xuelong Li

DOI: https://doi.org/10.1109/tip.2024.3388970

IF: 10.6

2024-04-27

IEEE Transactions on Image Processing

Abstract:High quality image reconstruction from undersampled -space data is key to accelerating MR scanning. Current deep learning methods are limited by the small receptive fields in reconstruction networks, which restrict the exploitation of long-range information, and impede the mitigation of full-image artifacts, particularly in 3D reconstruction tasks. Additionally, the substantial computational demands of 3D reconstruction considerably hinder advancements in related fields. To tackle these challenges, we propose the following: 1) A novel convolution operator named Faster Fourier Convolution (FasterFC), aims at providing an adaptable broad receptive field for spatial domain reconstruction networks with fast computational speed. 2) A split-slice strategy that substantially reduces the computational load of 3D reconstruction, enabling high-resolution, multi-coil, 3D MR image reconstruction while fully utilizing inter-layer and intra-layer information. 3) A single-to-group algorithm that efficiently utilizes scan-specific and data-driven priors to enhance -space interpolation effects. 4) A multi-stage, multi-coil, 3D fast MRI method, called the faster Fourier convolution based single-to-group network (FAS-Net), comprising a single-to-group -space interpolation algorithm and a FasterFC-based image domain reconstruction module, significantly minimizes the computational demands of 3D reconstruction through split-slice strategy. Experimental evaluations conducted on the NYU fastMRI and Stanford MRI Data datasets reveal that the FasterFC significantly enhances the quality of both 2D and 3D reconstruction results. Moreover, FAS-Net, characterized as a method that can achieve high-resolution (320, 320, 256), multi-coil, (8 coils), 3D fast MRI, exhibits superior reconstruction performance compared to other state-of-the-art 2D and 3D methods.

computer science, artificial intelligence,engineering, electrical & electronic
Distortion-Corrected Image Reconstruction with Deep Learning on an MRI-Linac

Shanshan Shan,Yang Gao,Paul Z. Y. Liu,Brendan Whelan,Hongfu Sun,Bin Dong,Feng Liu,David E. J. Waddington

2023-03-20

Abstract:Magnetic resonance imaging (MRI) is increasingly utilized for image-guided radiotherapy due to its outstanding soft-tissue contrast and lack of ionizing radiation. However, geometric distortions caused by gradient nonlinearity (GNL) limit anatomical accuracy, potentially compromising the quality of tumour treatments. In addition, slow MR acquisition and reconstruction limit the potential for real-time image guidance. Here, we demonstrate a deep learning-based method that rapidly reconstructs distortion-corrected images from raw k-space data for real-time MR-guided radiotherapy applications. We leverage recent advances in interpretable unrolling networks to develop a Distortion-Corrected Reconstruction Network (DCReconNet) that applies convolutional neural networks (CNNs) to learn effective regularizations and nonuniform fast Fourier transforms for GNL-encoding. DCReconNet was trained on a public MR brain dataset from eleven healthy volunteers for fully sampled and accelerated techniques including parallel imaging (PI) and compressed sensing (CS). The performance of DCReconNet was tested on phantom and volunteer brain data acquired on a 1.0T MRI-Linac. The DCReconNet, CS- and PI-based reconstructed image quality was measured by structural similarity (SSIM) and root-mean-squared error (RMSE) for numerical comparisons. The computation time for each method was also reported. Phantom and volunteer results demonstrated that DCReconNet better preserves image structure when compared to CS- and PI-based reconstruction methods. DCReconNet resulted in highest SSIM (0.95 median value) and lowest RMSE (<0.04) on simulated brain images with four times acceleration. DCReconNet is over 100-times faster than iterative, regularized reconstruction methods. DCReconNet provides fast and geometrically accurate image reconstruction and has potential for real-time MRI-guided radiotherapy applications.

Image and Video Processing
Deep learning for undersampled MRI reconstruction

Chang Min Hyun,Hwa Pyung Kim,Sung Min Lee,Sungchul Lee,Jin Keun Seo

DOI: https://doi.org/10.1088/1361-6560/aac71a

IF: 3.5

2018-06-25

Physics in Medicine and Biology

Abstract:This paper presents a deep learning method for faster magnetic resonance imaging (MRI) by reducing k-space data with sub-Nyquist sampling strategies and provides a rationale for why the proposed approach works well. Uniform subsampling is used in the time-consuming phase-encoding direction to capture high-resolution image information, while permitting the image-folding problem dictated by the Poisson summation formula. To deal with the localization uncertainty due to image folding, a small number of low-frequency k-space data are added. Training the deep learning net involves input and output images that are pairs of the Fourier transforms of the subsampled and fully sampled k-space data. Our experiments show the remarkable performance of the proposed method; only 29[Formula: see text] of the k-space data can generate images of high quality as effectively as standard MRI reconstruction with the fully sampled data.

engineering, biomedical,radiology, nuclear medicine & medical imaging
Deep Learning Based MRI Reconstruction with Transformer

Zhengliang Wu,Weibin Liao,Chao Yan,Mangsuo Zhao,Guowen Liu,Ning Ma,Xuesong Li

DOI: https://doi.org/10.1016/j.cmpb.2023.107452

IF: 6.1

2023-01-01

Computer Methods and Programs in Biomedicine

Abstract:Magnetic resonance imaging (MRI) has become one of the most powerful imaging techniques in medical diagnosis, yet the prolonged scanning time becomes a bottleneck for application. Reconstruction methods based on compress sensing (CS) have made progress in reducing this cost by acquiring fewer points in the k-space. Traditional CS methods impose restrictions from different sparse domains to regularize the optimization that always requires balancing time with accuracy. Neural network techniques enable learning a better prior from sample pairs and generating the results in an analytic way. In this paper, we propose a deep learning based reconstruction method to restore high-quality MRI images from undersampled k-space data in an end-to-end style. Unlike prior literature adopting convolutional neural networks (CNN), advanced Swin Transformer is used as the backbone of our work, which proved to be powerful in extracting deep features of the image. In addition, we combined the k-space consistency in the output and further improved the quality. We compared our models with several reconstruction methods and variants, and the experiment results proved that our model achieves the best results in samples at low sampling rates. The source code of KTMR could be acquired at https://github.com/BITwzl/KTMR.
Deep learning based reconstruction enables high-resolution electrical impedance tomography for lung function assessment

Shihao Zeng,Wang Chun Kwok,Peng Cao,Fedi Zouari,Philip Tin Yun Lee,Russell W Chan,Adrien Touboul

DOI: https://doi.org/10.1109/EMBC40787.2023.10340392

Abstract:Recently, deep learning based methods have shown potential as alternative approaches for lung time difference electrical impedance tomography (tdEIT) reconstruction other than traditional regularized least square methods, that have inherent severe ill-posedness and low spatial resolution posing challenges for further interpretation. However, the validation of deep learning reconstruction quality is mainly focused on simulated data rather than in vivo human chest data, and on image quality rather than clinical indicator accuracy. In this study, a variational autoencoder is trained on high-resolution human chest simulations, and inference results on an EIT dataset collected from 22 healthy subjects performing various breathing paradigms are benchmarked with simultaneous spirometry measurements. The deep learning reconstructed global conductivity is significantly correlated with measured volume-time curves with correlation > 0.9. EIT lung function indicators from the reconstruction are also highly correlated with standard spirometry indicators with correlation > 0.75.Clinical Relevance- Our deep learning reconstruction method of lung tdEIT can predict lung volume and spirometry indicators while generating high-resolution EIT images, revealing potential of being a competitive approach in clinical settings.
MRI Reconstruction with Interpretable Pixel-Wise Operations Using Reinforcement Learning

Wentian Li,Xidong Feng,Haotian An,Xiang Yao Ng,Yu-Jin Zhang

DOI: https://doi.org/10.1609/aaai.v34i01.5423

2020-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Compressed sensing magnetic resonance imaging (CS-MRI) is a technique aimed at accelerating the data acquisition of MRI. While down-sampling in k-space proportionally reduces the data acquisition time, it results in images corrupted by aliasing artifacts and blur. To reconstruct images from the down-sampled k-space, recent deep-learning based methods have shown better performance compared with classical optimization-based CS-MRI methods. However, they usually use deep neural networks as a black-box, which directly maps the corrupted images to the target images from fully-sampled k-space data. This lack of transparency may impede practical usage of such methods. In this work, we propose a deep reinforcement learning based method to reconstruct the corrupted images with meaningful pixel-wise operations (e.g. edge enhancing filters), so that the reconstruction process is transparent to users. Specifically, MRI reconstruction is formulated as Markov Decision Process with discrete actions and continuous action parameters. We conduct experiments on MICCAI dataset of brain tissues and fastMRI dataset of knee images. Our proposed method performs favorably against previous approaches. Our trained model learns to select pixel-wise operations that correspond to the anatomical structures in the MR images. This makes the reconstruction process more interpretable, which would be helpful for further medical analysis.
Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and Methodologies from CNN, GAN to Attention and Transformers

Jiahao Huang,Yingying Fang,Yang Nan,Huanjun Wu,Yinzhe Wu,Zhifan Gao,Yang Li,Zidong Wang,Pietro Lio,Daniel Rueckert,Yonina C. Eldar,Guang Yang

DOI: https://doi.org/10.48550/arXiv.2204.01706

2022-04-01

Image and Video Processing

Abstract:Research studies have shown no qualms about using data driven deep learning models for downstream tasks in medical image analysis, e.g., anatomy segmentation and lesion detection, disease diagnosis and prognosis, and treatment planning. However, deep learning models are not the sovereign remedy for medical image analysis when the upstream imaging is not being conducted properly (with artefacts). This has been manifested in MRI studies, where the scanning is typically slow, prone to motion artefacts, with a relatively low signal to noise ratio, and poor spatial and/or temporal resolution. Recent studies have witnessed substantial growth in the development of deep learning techniques for propelling fast MRI. This article aims to (1) introduce the deep learning based data driven techniques for fast MRI including convolutional neural network and generative adversarial network based methods, (2) survey the attention and transformer based models for speeding up MRI reconstruction, and (3) detail the research in coupling physics and data driven models for MRI acceleration. Finally, we will demonstrate through a few clinical applications, explain the importance of data harmonisation and explainable models for such fast MRI techniques in multicentre and multi-scanner studies, and discuss common pitfalls in current research and recommendations for future research directions.
Static MRI Reconstruction Based on K-space and Image-domain Information

Zhenjing Li,Jinxu Tao,Wajiha Kainat

DOI: https://doi.org/10.1145/3473465.3473467

2021-01-01

Abstract:In order to accelerate the imaging process of MRI (Magnetic Resonance Imaging), CS-MRI (Compressed Sensing Magnetic Resonance Imaging) utilizes the prior information of MR images and reconstructs under-sampled MR images by solving an optimization problem through an iterative algorithm, and it is time consuming. With the emergence of deep learning technology, more and more optimization problems can be solved through well-designed networks and large amounts of training data. Therefore, DL-Based (Deep Learning-Based) methods have attracted much attention. However, most of the current work simply treats MRI reconstruction as an image-to-image task, so there is still a lot of room for improvement in how to better integrate MRI information. This paper proposes a new DL-based method, which reconstructs the MR images in both k-space and image domain using several sub-networks and fuses information among different sub-networks. We also used down-sampling and up-sampling pairs to reduce the computational complexity. Our proposed architecture obtained promising experimental results on Calgary-Campinas Brain MRI datasets.
Deep Cardiac MRI Reconstruction with ADMM

George Yiasemis,Nikita Moriakov,Jan-Jakob Sonke,Jonas Teuwen

2023-10-10

Abstract:Cardiac magnetic resonance imaging is a valuable non-invasive tool for identifying cardiovascular diseases. For instance, Cine MRI is the benchmark modality for assessing the cardiac function and anatomy. On the other hand, multi-contrast (T1 and T2) mapping has the potential to assess pathologies and abnormalities in the myocardium and interstitium. However, voluntary breath-holding and often arrhythmia, in combination with MRI's slow imaging speed, can lead to motion artifacts, hindering real-time acquisition image quality. Although performing accelerated acquisitions can facilitate dynamic imaging, it induces aliasing, causing low reconstructed image quality in Cine MRI and inaccurate T1 and T2 mapping estimation. In this work, inspired by related work in accelerated MRI reconstruction, we present a deep learning (DL)-based method for accelerated cine and multi-contrast reconstruction in the context of dynamic cardiac imaging. We formulate the reconstruction problem as a least squares regularized optimization task, and employ vSHARP, a state-of-the-art DL-based inverse problem solver, which incorporates half-quadratic variable splitting and the alternating direction method of multipliers with neural networks. We treat the problem in two setups; a 2D reconstruction and a 2D dynamic reconstruction task, and employ 2D and 3D deep learning networks, respectively. Our method optimizes in both the image and k-space domains, allowing for high reconstruction fidelity. Although the target data is undersampled with a Cartesian equispaced scheme, we train our model using both Cartesian and simulated non-Cartesian undersampling schemes to enhance generalization of the model to unseen data. Furthermore, our model adopts a deep neural network to learn and refine the sensitivity maps of multi-coil k-space data. Lastly, our method is jointly trained on both, undersampled cine and multi-contrast data.

Image and Video Processing,Computer Vision and Pattern Recognition,Medical Physics
Complementation‐reinforced network for integrated reconstruction and segmentation of pulmonary gas MRI with high acceleration

Zimeng Li,Sa Xiao,Cheng Wang,Haidong Li,Xiuchao Zhao,Qian Zhou,Qiuchen Rao,Yuan Fang,Junshuai Xie,Lei Shi,Chaohui Ye,Xin Zhou

DOI: https://doi.org/10.1002/mp.16591

IF: 4.506

2023-07-04

Medical Physics

Abstract:Background Hyperpolarized (HP) gas MRI enables the clear visualization of lung structure and function. Clinically relevant biomarkers, such as ventilated defect percentage (VDP) derived from this modality can quantify lung ventilation function. However, long imaging time leads to image quality degradation and causes discomfort to the patients. Although accelerating MRI by undersampling k‐space data is available, accurate reconstruction and segmentation of lung images are quite challenging at high acceleration factors. Purpose To simultaneously improve the performance of reconstruction and segmentation of pulmonary gas MRI at high acceleration factors by effectively utilizing the complementary information in different tasks. Methods A complementation‐reinforced network is proposed, which takes the undersampled images as input and outputs both the reconstructed images and the segmentation results of lung ventilation defects. The proposed network comprises a reconstruction branch and a segmentation branch. To effectively exploit the complementary information, several strategies are designed in the proposed network. Firstly, both branches adopt the encoder‐decoder architecture, and their encoders are designed to share convolutional weights for facilitating knowledge transfer. Secondly, a designed feature‐selecting block discriminately feeds shared features into decoders of both branches, which can adaptively pick suitable features for each task. Thirdly, the segmentation branch incorporates the lung mask obtained from the reconstructed images to enhance the accuracy of the segmentation results. Lastly, the proposed network is optimized by a tailored loss function that efficiently combines and balances these two tasks, in order to achieve mutual benefits. Results Experimental results on the pulmonary HP 129Xe MRI dataset (including 43 healthy subjects and 42 patients) show that the proposed network outperforms state‐of‐the‐art methods at high acceleration factors (4, 5, and 6). The peak signal‐to‐noise ratio (PSNR), structural similarity (SSIM), and Dice score of the proposed network are enhanced to 30.89, 0.875, and 0.892, respectively. Additionally, the VDP obtained from the proposed network has good correlations with that obtained from fully sampled images (r = 0.984). At the highest acceleration factor of 6, the proposed network promotes PSNR, SSIM, and Dice score by 7.79%, 5.39%, and 9.52%, respectively, in comparison to the single‐task models. Conclusion The proposed method effectively enhances the reconstruction and segmentation performance at high acceleration factors up to 6. It facilitates fast and high‐quality lung imaging and segmentation, and provides valuable support in the clinical diagnosis of lung diseases.

radiology, nuclear medicine & medical imaging
Deep MRI Reconstruction: Unrolled Optimization Algorithms Meet Neural Networks

Dong Liang,Jing Cheng,Ziwen Ke,Leslie Ying

DOI: https://doi.org/10.48550/arXiv.1907.11711

2019-07-26

Abstract:Image reconstruction from undersampled k-space data has been playing an important role for fast MRI. Recently, deep learning has demonstrated tremendous success in various fields and also shown potential to significantly speed up MR reconstruction with reduced measurements. This article gives an overview of deep learning-based image reconstruction methods for MRI. Three types of deep learning-based approaches are reviewed, the data-driven, model-driven and integrated approaches. The main structure of each network in three approaches is explained and the analysis of common parts of reviewed networks and differences in-between are highlighted. Based on the review, a number of signal processing issues are discussed for maximizing the potential of deep reconstruction for fast MRI. the discussion may facilitate further development of "optimal" network and performance analysis from a theoretical point of view.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Signal Processing,Medical Physics
A Deep Learning Reconstruction Method for Sparsely Spaced Multidetector Helical CT Using Cascaded Dual-Domain CNN

Ao Zheng,Hewei Gao,Li Zhang,Yuxiang Xing

DOI: https://doi.org/10.1117/12.2548774

2019-01-01

Abstract:Helical CT has been widely used in clinical diagnosis. Sparsely spaced multidetector in z direction can increase the coverage of the detector provided limited detector rows. It can speed up volumetric CT scan, lower the radiation dose and reduce motion artifacts. However, it leads to insufficient data for reconstruction. That means reconstructions from general analytical methods will have severe artifacts. Iterative reconstruction methods might be able to deal with this situation but with the cost of huge computational load. In this work, we propose a cascaded dual-domain deep learning method that completes both data transformation in projection domain and error reduction in image domain. First, a convolutional neural network (CNN) in projection domain is constructed to estimate missing helical projection data and converting helical projection data to 2D fan-beam projection data. This step is to suppress helical artifacts and reduce the following computational cost. Then, an analytical linear operator is followed to transfer the data from projection domain to image domain. Finally, an image domain CNN is added to improve image quality further. These three steps work as an entirety and can be trained end to end. The overall network is trained using a simulated lung CT dataset with Poisson noise from 25 patients. We evaluate the trained network on another three patients and obtain very encouraging results with both visual examination and quantitative comparison. The resulting RRMSE is 6.56% and the SSIM is 99.60%. In addition, we test the trained network on the lung CT dataset with different noise level and a new dental CT dataset to demonstrate the generalization and robustness of our method.

Fast and Accurate Reconstruction of Human Lung Gas MRI with Deep Learning

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

Deep 3D reconstruction of synchrotron X-ray computed tomography for intact lungs

Accelerate gas diffusion-weighted MRI for lung morphometry with deep learning

Encoding Enhanced Complex CNN for Accurate and Highly Accelerated MRI

Deep Reconstruction Model For Dynamic Pet Images

Accelerating Magnetic Resonance Imaging Via Deep Learning.

Deep learning for fast MR imaging: a review for learning reconstruction from incomplete k-space data

Deep learning-based reconstruction of highly accelerated 3D MRI

Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

Distortion-Corrected Image Reconstruction with Deep Learning on an MRI-Linac

Deep learning for undersampled MRI reconstruction

Deep Learning Based MRI Reconstruction with Transformer

Deep learning based reconstruction enables high-resolution electrical impedance tomography for lung function assessment

MRI Reconstruction with Interpretable Pixel-Wise Operations Using Reinforcement Learning

Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and Methodologies from CNN, GAN to Attention and Transformers

Static MRI Reconstruction Based on K-space and Image-domain Information

Deep Cardiac MRI Reconstruction with ADMM

Complementation‐reinforced network for integrated reconstruction and segmentation of pulmonary gas MRI with high acceleration

Deep MRI Reconstruction: Unrolled Optimization Algorithms Meet Neural Networks

A Deep Learning Reconstruction Method for Sparsely Spaced Multidetector Helical CT Using Cascaded Dual-Domain CNN