The cell biology of Smo signalling and its relationships with GPCRs.

A. Ruiz-Gómez,Cristina Molnar,H. Holguín,F. Mayor,J. D. de Celis

DOI: https://doi.org/10.1016/J.BBAMEM.2006.09.020

2007-04-01

Biochimica et Biophysica Acta

Abstract:

What problem does this paper attempt to address?

Parallel Imaging and Convolutional Neural Network Combined Fast MR Image Reconstruction: Applications in Low-Latency Accelerated Real-Time Imaging.

Ziwu Zhou,Fei Han,Vahid Ghodrati,Yu Gao,Wotao Yin,Yingli Yang,Peng Hu

DOI: https://doi.org/10.1002/mp.13628

2019-01-01

Abstract:Purpose To develop and evaluate a parallel imaging and convolutional neural network combined image reconstruction framework for low-latency and high-quality accelerated real-time MR imaging. Methods Conventional Parallel Imaging reconstruction resolved as gradient descent steps was compacted as network layers and interleaved with convolutional layers in a general convolutional neural network. All parameters of the network were determined during the offline training process, and applied to unseen data once learned. The proposed network was first evaluated for real-time cardiac imaging at 1.5 T and real-time abdominal imaging at 0.35 T, using threefold to fivefold retrospective undersampling for cardiac imaging and threefold retrospective undersampling for abdominal imaging. Then, prospective undersampling with fourfold acceleration was performed on cardiac imaging to compare the proposed method with standard clinically available GRAPPA method and the state-of-the-art L1-ESPIRiT method. Results Both retrospective and prospective evaluations confirmed that the proposed network was able to images with a lower noise level and reduced aliasing artifacts in comparison with the single-coil based and L1-ESPIRiT reconstructions for cardiac imaging at 1.5 T, and the GRAPPA and L1-ESPIRiT reconstructions for abdominal imaging at 0.35 T. Using the proposed method, each frame can be reconstructed in less than 100 ms, suggesting its clinical compatibility. Conclusion The proposed Parallel Imaging and convolutional neural network combined reconstruction framework is a promising technique that allows low-latency and high-quality real-time MR imaging.
Undersampled Magnetic Resonance Image Reconstructions Based on a Combination of U-Nets and L1, L2, and TV Optimizations

Aline A. S. Thomas,Jonathan A. S. Lima,Cristiano J. Miosso,Mylene C. Q. Farias,Andrey S. Krylov,Yong Ding

DOI: https://doi.org/10.1109/ist55454.2022.9827727

2022-01-01

Abstract:Magnetic Resonance Imaging (MRI) plays a major role in the diagnosis of several diseases. However, the acquisition of measurements in the k-space domain, which is the basis for image reconstruction, takes a long time compared to other imaging modalities and is comparatively costly. In this context, undersampled MRI reconstruction is an approach for decreasing the acquisition duration and the exam's final cost. With this objective, both Compressed Sensing (CS) and Deep Learning (DL) provide techniques for generating good quality MRI images from undersampled measurements. In this paper, we combine CS and DL methods in order to investigate the potential increase in image quality over each isolated approach. We use reconstructions from from highly undersampled MRI signals using two CS approaches, the L1 and total minimizations, as inputs to a U-Net. We also use, for comparison, the reconstructions from the same undersampled signals using L2 minimization, and also test them as inputs to a U-net. The goal is to evaluate whether the the U-Net can improve the results of the CS reconstructions after learning from degraded and original image pairs. Our experimental results suggest that the combination of L1 or TV minimization with U-Nets can improve reconstruction, in terms of objective image quality, over each technique used in isolation.
Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

Xiaohan Liu,Yanwei Pang,Xuebin Sun,Yiming Liu,Yonghong Hou,Zhenchang Wang,Xuelong Li

DOI: https://doi.org/10.1109/tip.2024.3388970

IF: 10.6

2024-04-27

IEEE Transactions on Image Processing

Abstract:High quality image reconstruction from undersampled -space data is key to accelerating MR scanning. Current deep learning methods are limited by the small receptive fields in reconstruction networks, which restrict the exploitation of long-range information, and impede the mitigation of full-image artifacts, particularly in 3D reconstruction tasks. Additionally, the substantial computational demands of 3D reconstruction considerably hinder advancements in related fields. To tackle these challenges, we propose the following: 1) A novel convolution operator named Faster Fourier Convolution (FasterFC), aims at providing an adaptable broad receptive field for spatial domain reconstruction networks with fast computational speed. 2) A split-slice strategy that substantially reduces the computational load of 3D reconstruction, enabling high-resolution, multi-coil, 3D MR image reconstruction while fully utilizing inter-layer and intra-layer information. 3) A single-to-group algorithm that efficiently utilizes scan-specific and data-driven priors to enhance -space interpolation effects. 4) A multi-stage, multi-coil, 3D fast MRI method, called the faster Fourier convolution based single-to-group network (FAS-Net), comprising a single-to-group -space interpolation algorithm and a FasterFC-based image domain reconstruction module, significantly minimizes the computational demands of 3D reconstruction through split-slice strategy. Experimental evaluations conducted on the NYU fastMRI and Stanford MRI Data datasets reveal that the FasterFC significantly enhances the quality of both 2D and 3D reconstruction results. Moreover, FAS-Net, characterized as a method that can achieve high-resolution (320, 320, 256), multi-coil, (8 coils), 3D fast MRI, exhibits superior reconstruction performance compared to other state-of-the-art 2D and 3D methods.

computer science, artificial intelligence,engineering, electrical & electronic
Deep Learning Based MRI Reconstruction with Transformer

Zhengliang Wu,Weibin Liao,Chao Yan,Mangsuo Zhao,Guowen Liu,Ning Ma,Xuesong Li

DOI: https://doi.org/10.1016/j.cmpb.2023.107452

IF: 6.1

2023-01-01

Computer Methods and Programs in Biomedicine

Abstract:Magnetic resonance imaging (MRI) has become one of the most powerful imaging techniques in medical diagnosis, yet the prolonged scanning time becomes a bottleneck for application. Reconstruction methods based on compress sensing (CS) have made progress in reducing this cost by acquiring fewer points in the k-space. Traditional CS methods impose restrictions from different sparse domains to regularize the optimization that always requires balancing time with accuracy. Neural network techniques enable learning a better prior from sample pairs and generating the results in an analytic way. In this paper, we propose a deep learning based reconstruction method to restore high-quality MRI images from undersampled k-space data in an end-to-end style. Unlike prior literature adopting convolutional neural networks (CNN), advanced Swin Transformer is used as the backbone of our work, which proved to be powerful in extracting deep features of the image. In addition, we combined the k-space consistency in the output and further improved the quality. We compared our models with several reconstruction methods and variants, and the experiment results proved that our model achieves the best results in samples at low sampling rates. The source code of KTMR could be acquired at https://github.com/BITwzl/KTMR.
A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction

Jo Schlemper,Jose Caballero,Joseph V. Hajnal,Anthony Price,Daniel Rueckert

DOI: https://doi.org/10.48550/arXiv.1703.00555

2017-03-02

Abstract:The acquisition of Magnetic Resonance Imaging (MRI) is inherently slow. Inspired by recent advances in deep learning, we propose a framework for reconstructing MR images from undersampled data using a deep cascade of convolutional neural networks to accelerate the data acquisition process. We show that for Cartesian undersampling of 2D cardiac MR images, the proposed method outperforms the state-of-the-art compressed sensing approaches, such as dictionary learning-based MRI (DLMRI) reconstruction, in terms of reconstruction error, perceptual quality and reconstruction speed for both 3-fold and 6-fold undersampling. Compared to DLMRI, the error produced by the method proposed is approximately twice as small, allowing to preserve anatomical structures more faithfully. Using our method, each image can be reconstructed in 23 ms, which is fast enough to enable real-time applications.

Computer Vision and Pattern Recognition
Attention Hybrid Variational Net for Accelerated MRI Reconstruction

Guoyao Shen,Boran Hao,Mengyu Li,Chad W. Farris,Ioannis Ch. Paschalidis,Stephan W. Anderson,Xin Zhang

2023-06-22

Abstract:The application of compressed sensing (CS)-enabled data reconstruction for accelerating magnetic resonance imaging (MRI) remains a challenging problem. This is due to the fact that the information lost in k-space from the acceleration mask makes it difficult to reconstruct an image similar to the quality of a fully sampled image. Multiple deep learning-based structures have been proposed for MRI reconstruction using CS, both in the k-space and image domains as well as using unrolled optimization methods. However, the drawback of these structures is that they are not fully utilizing the information from both domains (k-space and image). Herein, we propose a deep learning-based attention hybrid variational network that performs learning in both the k-space and image domain. We evaluate our method on a well-known open-source MRI dataset and a clinical MRI dataset of patients diagnosed with strokes from our institution to demonstrate the performance of our network. In addition to quantitative evaluation, we undertook a blinded comparison of image quality across networks performed by a subspecialty trained radiologist. Overall, we demonstrate that our network achieves a superior performance among others under multiple reconstruction tasks.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Medical Physics
Deep Convolutional Neural Network for Compressive Sensing of Magnetic Resonance Images

Hong Lu,Xiaofei Zou,Longlong Liao,Kenli Li,Jie Liu

DOI: https://doi.org/10.1142/S0218001421520194

IF: 1.261

2021-01-01

International Journal of Pattern Recognition and Artificial Intelligence

Abstract:Compressive Sensing for Magnetic Resonance Imaging (CS-MRI) aims to reconstruct Magnetic Resonance (MR) images from under-sampled raw data. There are two challenges to improve CS-MRI methods, i.e. designing an under-sampling algorithm to achieve optimal sampling, as well as designing fast and small deep neural networks to obtain reconstructed MR images with superior quality. To improve the reconstruction quality of MR images, we propose a novel deep convolutional neural network architecture for CS-MRI named MRCSNet. The MRCSNet consists of three sub-networks, a compressive sensing sampling sub-network, an initial reconstruction sub-network, and a refined reconstruction sub-network. Experimental results demonstrate that MRCSNet generates high-quality reconstructed MR images at various under-sampling ratios, and also meets the requirements of real-time CS-MRI applications. Compared to state-of-the-art CS-MRI approaches, MRCSNet offers a significant improvement in reconstruction accuracies, such as Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity (SSIM). Besides, it reduces the reconstruction error evaluated by the Normalized Root-Mean-Square Error (NRMSE). The source codes are available at https://github.com/TaihuLight/MRCSNet.
Sparse MRI Reconstruction Using Multi-Contrast Image Guided Graph Representation.

Zongying Lai,Xiaobo Qu,Hengfa Lu,Xi Peng,Di Guo,Yu Yang,Gang Guo,Zhong Chen

DOI: https://doi.org/10.1016/j.mri.2017.07.009

IF: 3.13

2017-01-01

Magnetic Resonance Imaging

Abstract:Accelerating the imaging speed without sacrificing image structures plays an important role in magnetic resonance imaging. Under-sampling the k-space data and reconstructing the image with sparsity constraint is one efficient way to reduce the data acquisition time. However, achieving high acceleration factor is challenging since image structures may be lost or blurred when the acquired information is not sufficient. Therefore, incorporating extra knowledge to improve image reconstruction is expected for highly accelerated imaging. Fortunately, multi-contrast images in the same region of interest are usually acquired in magnetic resonance imaging protocols. In this work, we propose a new approach to reconstruct magnetic resonance images by learning the prior knowledge from these multi-contrast images with graph-based wavelet representations. We further formulate the reconstruction as a bi-level optimization problem to allow misalignment between these images. Experiments on realistic imaging datasets demonstrate that the proposed approach improves the image reconstruction significantly and is practical for real world application since patients are unnecessarily to stay still during successive reference image scans.
Compressed Sensing MRI Reconstruction Based on Generative Adversarial Nets

Tao Jiang,Jinxu Tao,Zhongfu Ye,Bensheng Qiu,Jinzhang Xu

DOI: https://doi.org/10.12783/dtcse/csse2018/24492

2018-01-01

DEStech Transactions on Computer Science and Engineering

Abstract:Compressed sensing magnetic resonance imaging(CS-MRI) achieves shorter acquisition time by reducing the sampling rate of k-space data. This not only cuts down the scanning cost, but also reduces the artifacts and alising caused by the patient's movement and improves the imaging quality. However, the iterative reconstruction of MRI based on compressed sensing needs very expensive computation. Recently, some works about CS-MRI reconstruction based on deep learning have achieved great success. In this paper, we proposed a novel network named ResGAN to improve imaging quality while significantly reducing MRI scan time. The proposed network, ResGAN, is a deep generative adversarial network, which learns a mapping from the under-sampled MRI data to fully sampled data by the generative network. In particular, we adopt the training strategy of residual learning to achieve lower convergence loss as well as avoiding over fitting. Moreover, despite of the pixel-wise L1-loss, the feed-forward generative network also utilizes frequency domain loss to maintain data consistency. Our method obtained promising experimental results on both imaging quality and reconstruction speed for 1.5T brain MRI while only 30 percent of the raw k-space data are sampled using radial sampling pattern.
Joint Under-Sampling Pattern and Dual-Domain Reconstruction for Accelerating Multi-Contrast MRI

Pengcheng Lei,Le Hu,Faming Fang,Guixu Zhang

DOI: https://doi.org/10.1109/TIP.2024.3445729

2024-08-23

Abstract:Multi-Contrast Magnetic Resonance Imaging (MCMRI) utilizes the short-time reference image to facilitate the reconstruction of the long-time target one, providing a new solution for fast MRI. Although various methods have been proposed, they still have certain limitations. (1) Existing methods featuring the preset under-sampling patterns give rise to redundancy between multi-contrast images and limit their model performance. (2) Most methods focus on the information in the image domain, prior knowledge in the k-space domain has not been fully explored. (3) Most networks are manually designed and lack certain physical interpretability. To address these issues, we propose a joint optimization of the under-sampling pattern and a deep-unfolding dual-domain network for accelerating MCMRI. Firstly, to reduce the redundant information and sample more contrast-specific information, we propose a new framework to learn the optimal under-sampling pattern for MCMRI. Secondly, a dual-domain model is established to reconstruct the target image in both the image domain and the k-space frequency domain. The model in the image domain introduces a spatial transformation to explicitly model the inconsistent and unaligned structures of MCMRI. The model in the k-space learns prior knowledge from the frequency domain, enabling the model to capture more global information from the input images. Thirdly, we employ the proximal gradient algorithm to optimize the proposed model and then unfold the iterative results into a deep-unfolding network, called MC-DuDoN. We evaluate the proposed MC-DuDoN on MCMRI super-resolution and reconstruction tasks. Experimental results give credence to the superiority of the current model. In particular, since our approach explicitly models the inconsistent structures, it shows robustness on spatially misaligned MCMRI. In the reconstruction task, compared with conventional masks, the learned mask restores more realistic images, even under an ultra-high acceleration ratio (×30). Code is available at https://github.com/lpcccc-cv/MC-DuDoNet.
ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer

Pengfei Guo,Yiqun Mei,Jinyuan Zhou,Shanshan Jiang,Vishal M. Patel

DOI: https://doi.org/10.1109/tmi.2023.3314747

IF: 10.6

2023-01-01

IEEE Transactions on Medical Imaging

Abstract:The accelerating magnetic resonance imaging (MRI) reconstruction process is a challenging ill-posed inverse problem due to the excessive under-sampling operation in k-space. In this paper, we propose a recurrent Transformer model, namely ReconFormer, for MRI reconstruction, which can iteratively reconstruct high-fidelity magnetic resonance images from highly under-sampled k-space data (e.g., up to 8× acceleration). In particular, the proposed architecture is built upon Recurrent Pyramid Transformer Layers (RPTLs). The core design of the proposed method is Recurrent Scale-wise Attention (RSA), which jointly exploits intrinsic multi-scale information at every architecture unit as well as the dependencies of the deep feature correlation through recurrent states. Moreover, benefiting from its recurrent nature, ReconFormer is lightweight compared to other baselines and only contains 1.1 M trainable parameters. We validate the effectiveness of ReconFormer on multiple datasets with different magnetic resonance sequences and show that it achieves significant improvements over the state-of-the-art methods with better parameter efficiency. The implementation code and pre-trained weights are available at https://github.com/guopengf/ReconFormer.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction

Zalan Fabian,Berk Tinaz,Mahdi Soltanolkotabi

DOI: https://doi.org/10.48550/arXiv.2203.08213

2022-03-15

Image and Video Processing

Abstract:In accelerated MRI reconstruction, the anatomy of a patient is recovered from a set of under-sampled and noisy measurements. Deep learning approaches have been proven to be successful in solving this ill-posed inverse problem and are capable of producing very high quality reconstructions. However, current architectures heavily rely on convolutions, that are content-independent and have difficulties modeling long-range dependencies in images. Recently, Transformers, the workhorse of contemporary natural language processing, have emerged as powerful building blocks for a multitude of vision tasks. These models split input images into non-overlapping patches, embed the patches into lower-dimensional tokens and utilize a self-attention mechanism that does not suffer from the aforementioned weaknesses of convolutional architectures. However, Transformers incur extremely high compute and memory cost when 1) the input image resolution is high and 2) when the image needs to be split into a large number of patches to preserve fine detail information, both of which are typical in low-level vision problems such as MRI reconstruction, having a compounding effect. To tackle these challenges, we propose HUMUS-Net, a hybrid architecture that combines the beneficial implicit bias and efficiency of convolutions with the power of Transformer blocks in an unrolled and multi-scale network. HUMUS-Net extracts high-resolution features via convolutional blocks and refines low-resolution features via a novel Transformer-based multi-scale feature extractor. Features from both levels are then synthesized into a high-resolution output reconstruction. Our network establishes new state of the art on the largest publicly available MRI dataset, the fastMRI dataset. We further demonstrate the performance of HUMUS-Net on two other popular MRI datasets and perform fine-grained ablation studies to validate our design.
Simultaneous Image Reconstruction and Lesion Segmentation in Accelerated MRI Using Multitasking Learning.

Bin Sui,Jun Lv,Xiangrong Tong,Yan Li,Chengyan Wang

DOI: https://doi.org/10.1002/mp.15213

2021-01-01

Abstract:Purpose Magnetic resonance imaging (MRI) serves as an important medical imaging modality for a variety of clinical applications. However, the problem of long imaging time limited its wide usage. In addition, prolonged scan time will cause discomfort to the patient, leading to severe image artifacts. On the other hand, manually lesion segmentation is time consuming. Algorithm-based automatic lesion segmentation is still challenging, especially for accelerated imaging with low quality. Methods In this paper, we proposed a multitask learning-based method to perform image reconstruction and lesion segmentation simultaneously, called "RecSeg". Our hypothesis is that both tasks can benefit from the usage of the proposed combined model. In the experiment, we validated the proposed multitask model on MR k-space data with different acceleration factors (2x, 4x, and 6x). Two connected U-nets were used for the tasks of liver and renal image reconstruction and segmentation. A total of 50 healthy subjects and 100 patients with hepatocellular carcinoma were included for training and testing. For the segmentation part, we use healthy subjects to verify organ segmentation, and hepatocellular carcinoma patients to verify lesion segmentation. The organs and lesions were manually contoured by an experienced radiologist. Results Experimental results show that the proposed RecSeg yielded the highest PSNR (RecSeg: 32.39 +/- 1.64 vs. KSVD: 29.53 +/- 2.74 and single U-net: 31.18 +/- 1.68, respectively, p < 0.05) and highest structural similarity index measure (SSIM) (RecSeg: 0.93 +/- 0.01 vs. KSVD: 0.88 +/- 0.02 and single U-net: 0.90 +/- 0.01, respectively, p < 0.05) under 6x acceleration. Moreover, in the task of lesion segmentation, it is proposed that RecSeg produced the highest Dice score (RecSeg: 0.86 +/- 0.01 vs. KSVD: 0.82 +/- 0.01 and single U-net: 0.84 +/- 0.01, respectively, p < 0.05). Conclusions This study focused on the simultaneous reconstruction of medical images and the segmentation of organs and lesions. It is observed that the multitask learning-based method can improve performances of both image reconstruction and lesion segmentation.
Fast Multi-Contrast MRI Acquisition by Optimal Sampling of Information Complementary to Pre-Acquired MRI Contrast

Junwei Yang,Xiao-Xin Li,Feihong Liu,Dong Nie,Pietro Lio,Haikun Qi,Dinggang Shen

DOI: https://doi.org/10.1109/tmi.2022.3227262

IF: 10.6

2023-05-05

IEEE Transactions on Medical Imaging

Abstract:Recent studies on multi-contrast MRI reconstruction have demonstrated the potential of further accelerating MRI acquisition by exploiting correlation between contrasts. Most of the state-of-the-art approaches have achieved improvement through the development of network architectures for fixed under-sampling patterns, without considering inter-contrast correlation in the under-sampling pattern design. On the other hand, sampling pattern learning methods have shown better reconstruction performance than those with fixed under-sampling patterns. However, most under-sampling pattern learning algorithms are designed for single contrast MRI without exploiting complementary information between contrasts. To this end, we propose a framework to optimize the under-sampling pattern of a target MRI contrast which complements the acquired fully-sampled reference contrast. Specifically, a novel image synthesis network is introduced to extract the redundant information contained in the reference contrast, which is exploited in the subsequent joint pattern optimization and reconstruction network. We have demonstrated superior performance of our learned under-sampling patterns on both public and in-house datasets, compared to the commonly used under-sampling patterns and state-of-the-art methods that jointly optimize the reconstruction network and the under-sampling patterns, up to 8-fold under-sampling factor.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Deep learning-based reconstruction of highly accelerated 3D MRI

Sangtae Ahn,Uri Wollner,Graeme McKinnon,Isabelle Heukensfeldt Jansen,Rafi Brada,Dan Rettmann,Ty A. Cashen,John Huston,J. Kevin DeMarco,Robert Y. Shih,Joshua D. Trzasko,Christopher J. Hardy,Thomas K. F. Foo

DOI: https://doi.org/10.48550/arxiv.2203.04674

2022-03-09

Image and Video Processing

Abstract:Purpose: To accelerate brain 3D MRI scans by using a deep learning method for reconstructing images from highly-undersampled multi-coil k-space data Methods: DL-Speed, an unrolled optimization architecture with dense skip-layer connections, was trained on 3D T1-weighted brain scan data to reconstruct complex-valued images from highly-undersampled k-space data. The trained model was evaluated on 3D MPRAGE brain scan data retrospectively-undersampled with a 10-fold acceleration, compared to a conventional parallel imaging method with a 2-fold acceleration. Scores of SNR, artifacts, gray/white matter contrast, resolution/sharpness, deep gray-matter, cerebellar vermis, anterior commissure, and overall quality, on a 5-point Likert scale, were assessed by experienced radiologists. In addition, the trained model was tested on retrospectively-undersampled 3D T1-weighted LAVA (Liver Acquisition with Volume Acceleration) abdominal scan data, and prospectively-undersampled 3D MPRAGE and LAVA scans in three healthy volunteers and one, respectively. Results: The qualitative scores for DL-Speed with a 10-fold acceleration were higher than or equal to those for the parallel imaging with 2-fold acceleration. DL-Speed outperformed a compressed sensing method in quantitative metrics on retrospectively-undersampled LAVA data. DL-Speed was demonstrated to perform reasonably well on prospectively-undersampled scan data, realizing a 2-5 times reduction in scan time. Conclusion: DL-Speed was shown to accelerate 3D MPRAGE and LAVA with up to a net 10-fold acceleration, achieving 2-5 times faster scans compared to conventional parallel imaging and acceleration, while maintaining diagnostic image quality and real-time reconstruction. The brain scan data-trained DL-Speed also performed well when reconstructing abdominal LAVA scan data, demonstrating versatility of the network.
Multi-Contrast MRI Reconstruction Based on Frequency Domain Separation and Cross-Self-Attention

Yiran Qiu,Haotian Zhang,Qiaoyu Ma,Guangsong Yang,Zongying Lai

DOI: https://doi.org/10.1109/access.2024.3388379

IF: 3.9

2024-04-30

IEEE Access

Abstract:Multi-contrast magnetic resonance imaging can bring convenience to medical diagnosis and decision-making. However, due to the long acquisition time, the images are easily disturbed by motion artifacts. To accelerate MRI, the approach of under-sampling k-space data has been used. This approach leads to the deterioration of MR image quality. To restore images, we proposed a Residual Convolution Swin Transformer Block (RCSTB), which includes local feature representation in a convolutional neural network module and global long-term feature extraction in the transformer. Additionally, similarities reflected by structure information in high frequency among multi-contrast magnetic resonance images are separated and are fused with a cross-self-attention mechanism to assist reconstruction of under-sampled magnetic resonance images. The residual information in frequency domain separation from the RCSTB reconstructed images was used to complete the final reconstruction. Experimental results show that our method outperforms state-of-art in Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), and Relative L2 Norm Error (RLNE) under different sampling patterns. The reconstruction of details has achieved visible improvements to the naked eye.

computer science, information systems,telecommunications,engineering, electrical & electronic
A Hybrid Residual Attention Convolutional Neural Network for Compressed Sensing Magnetic Resonance Image Reconstruction

Ki-Chul Kwon,Rupali Kiran Shinde,Shariar Md Imtiaz,Nam Kim,Md. Biddut Hossain

DOI: https://doi.org/10.3390/diagnostics13071306

IF: 3.6

2023-03-31

Diagnostics

Abstract:We propose a dual-domain deep learning technique for accelerating compressed sensing magnetic resonance image reconstruction. An advanced convolutional neural network with residual connectivity and an attention mechanism was developed for frequency and image domains. First, the sensor domain subnetwork estimates the unmeasured frequencies of k-space to reduce aliasing artifacts. Second, the image domain subnetwork performs a pixel-wise operation to remove blur and noisy artifacts. The skip connections efficiently concatenate the feature maps to alleviate the vanishing gradient problem. An attention gate in each decoder layer enhances network generalizability and speeds up image reconstruction by eliminating irrelevant activations. The proposed technique reconstructs real-valued clinical images from sparsely sampled k-spaces that are identical to the reference images. The performance of this novel approach was compared with state-of-the-art direct mapping, single-domain, and multi-domain methods. With acceleration factors (AFs) of 4 and 5, our method improved the mean peak signal-to-noise ratio (PSNR) to 8.67 and 9.23, respectively, compared with the single-domain Unet model; similarly, our approach increased the average PSNR to 3.72 and 4.61, respectively, compared with the multi-domain W-net. Remarkably, using an AF of 6, it enhanced the PSNR by 9.87 ± 1.55 and 6.60 ± 0.38 compared with Unet and W-net, respectively.

medicine, general & internal
MRI Reconstruction with Interpretable Pixel-Wise Operations Using Reinforcement Learning

Wentian Li,Xidong Feng,Haotian An,Xiang Yao Ng,Yu-Jin Zhang

DOI: https://doi.org/10.1609/aaai.v34i01.5423

2020-01-01

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:Compressed sensing magnetic resonance imaging (CS-MRI) is a technique aimed at accelerating the data acquisition of MRI. While down-sampling in k-space proportionally reduces the data acquisition time, it results in images corrupted by aliasing artifacts and blur. To reconstruct images from the down-sampled k-space, recent deep-learning based methods have shown better performance compared with classical optimization-based CS-MRI methods. However, they usually use deep neural networks as a black-box, which directly maps the corrupted images to the target images from fully-sampled k-space data. This lack of transparency may impede practical usage of such methods. In this work, we propose a deep reinforcement learning based method to reconstruct the corrupted images with meaningful pixel-wise operations (e.g. edge enhancing filters), so that the reconstruction process is transparent to users. Specifically, MRI reconstruction is formulated as Markov Decision Process with discrete actions and continuous action parameters. We conduct experiments on MICCAI dataset of brain tissues and fastMRI dataset of knee images. Our proposed method performs favorably against previous approaches. Our trained model learns to select pixel-wise operations that correspond to the anatomical structures in the MR images. This makes the reconstruction process more interpretable, which would be helpful for further medical analysis.
Undersampled Multi-contrast MRI Reconstruction Based on Double-domain Generative Adversarial Network

Haining Wei,Zhongsen Li,Shuai Wang,Rui Li

DOI: https://doi.org/10.1109/jbhi.2022.3143104

IF: 7.7

2022-01-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Multi-contrast magnetic resonance imaging can provide comprehensive information for clinical diagnosis. However, multi-contrast imaging suffers from long acquisition time, which makes it inhibitive for daily clinical practice. Subsampling k-space is one of the main methods to speed up scan time. Missing k-space samples will lead to inevitable serious artifacts and noise. Considering the assumption that different contrast modalities share some mutual information, it may be possible to exploit this redundancy to accelerate multi-contrast imaging acquisition. Recently, generative adversarial network shows superior performance in image reconstruction and synthesis. Some studies based on k-space reconstruction also exhibit superior performance over conventional state-of-art method. In this study, we propose a cross-domain two-stage generative adversarial network for multi-contrast images reconstruction based on prior full-sampled contrast and undersampled information. The new approach integrates reconstruction and synthesis, which estimates and completes the missing k-space and then refines in image space. It takes one fully-sampled contrast modality data and highly undersampled data from several other modalities as input, and outputs high quality images for each contrast simultaneously. The network is trained and tested on a public brain dataset from healthy subjects. Quantitative comparisons against baseline clearly indicate that the proposed method can effectively reconstruct undersampled images. Even under high acceleration, the network still can recover texture details and reduce artifacts.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems

The cell biology of Smo signalling and its relationships with GPCRs.

Parallel Imaging and Convolutional Neural Network Combined Fast MR Image Reconstruction: Applications in Low-Latency Accelerated Real-Time Imaging.

Undersampled Magnetic Resonance Image Reconstructions Based on a Combination of U-Nets and L1, L2, and TV Optimizations

Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

Deep Learning Based MRI Reconstruction with Transformer

A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction

Attention Hybrid Variational Net for Accelerated MRI Reconstruction

Deep Convolutional Neural Network for Compressive Sensing of Magnetic Resonance Images

Sparse MRI Reconstruction Using Multi-Contrast Image Guided Graph Representation.

Compressed Sensing MRI Reconstruction Based on Generative Adversarial Nets

Joint Under-Sampling Pattern and Dual-Domain Reconstruction for Accelerating Multi-Contrast MRI

ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer

HUMUS-Net: Hybrid unrolled multi-scale network architecture for accelerated MRI reconstruction

Simultaneous Image Reconstruction and Lesion Segmentation in Accelerated MRI Using Multitasking Learning.

Fast Multi-Contrast MRI Acquisition by Optimal Sampling of Information Complementary to Pre-Acquired MRI Contrast

Deep learning-based reconstruction of highly accelerated 3D MRI

Multi-Contrast MRI Reconstruction Based on Frequency Domain Separation and Cross-Self-Attention

A Hybrid Residual Attention Convolutional Neural Network for Compressed Sensing Magnetic Resonance Image Reconstruction

MRI Reconstruction with Interpretable Pixel-Wise Operations Using Reinforcement Learning

Undersampled Multi-contrast MRI Reconstruction Based on Double-domain Generative Adversarial Network