Comparison of pore-forming ability in membranes of a native and a recombinant variant of Sticholysin II from Stichodactyla helianthus.

I. Pazos,D. Martínez,M. Tejuca,A. Valle,Á. D. del Pozo,C. Álvarez,M. E. Lanio,E. Lissi

DOI: https://doi.org/10.1016/S0041-0101(03)00227-7

IF: 3.035

2003-11-01

Toxicon

Abstract:

What problem does this paper attempt to address?

Deep Fusion Network Based Sparse View CT Reconstructions for Clinical Diagnostic Scanners

Yangdi Xu,Jingsong Li,Hongxiang Lin

DOI: https://doi.org/10.1109/embc40787.2023.10341175

2023-01-01

Abstract:Sparse view CT scan has the advantage of reducing radiation exposure and scanning time in clinical diagnosis. However, the limited number of x-ray projections can make the reconstruction problem ill posed and result in image artifacts. To tackle the problem, we propose a novel model-based deep fusion network(DFN) satisfying the clinical set-up. It extracts fused features encoded from both the sinogram and the preliminary reconstructed image generated by filtered back projection (FBP) to improve the quality of reconstruction. The preliminary reconstructed image endows fused features with prior knowledge that facilitate the convergence of neural network to high-quality reconstruction images. We design a custom loss for training that enforces the network to learn both the pixel value and the integrity of the tissue structure. A synthetic sparse view breast CT dataset from American Association of Physicists in Medicine(AAPM) is used for training, validation and testing. The qualitative and quantitative evaluations show that the DFN reconstruction algorithm significantly improves in balancing between the image quality and reconstruction speed, hence enables fast and high quality CT reconstruction despite the sparse view limitations.
DCT-net: Dual-domain cross-fusion transformer network for MRI reconstruction

Bin Wang,Yusheng Lian,Xingchuang Xiong,Han Zhou,Zilong Liu,Xiaohao Zhou

DOI: https://doi.org/10.1016/j.mri.2024.01.007

IF: 3.13

2024-04-01

Magnetic Resonance Imaging

Abstract:Current challenges in Magnetic Resonance Imaging (MRI) include long acquisition times and motion artifacts. To address these issues, under-sampled k-space acquisition has gained popularity as a fast imaging method. However, recovering fine details from under-sampled data remains challenging. In this study, we introduce a pioneering deep learning approach, namely DCT-Net, designed for dual-domain MRI reconstruction. DCT-Net seamlessly integrates information from the image domain (IRM) and frequency domain (FRM), utilizing a novel Cross Attention Block (CAB) and Fusion Attention Block (FAB). These innovative blocks enable precise feature extraction and adaptive fusion across both domains, resulting in a significant enhancement of the reconstructed image quality. The adaptive interaction and fusion mechanisms of CAB and FAB contribute to the method's effectiveness in capturing distinctive features and optimizing image reconstruction. Comprehensive ablation studies have been conducted to assess the contributions of these modules to reconstruction quality and accuracy. Experimental results on the FastMRI (2023) and Calgary-Campinas datasets (2021) demonstrate the superiority of our MRI reconstruction framework over other typical methods (most are illustrated in 2023 or 2022) in both qualitative and quantitative evaluations. This holds for knee and brain datasets under 4× and 8× accelerated imaging scenarios.

radiology, nuclear medicine & medical imaging
Parallel Imaging and Convolutional Neural Network Combined Fast MR Image Reconstruction: Applications in Low-Latency Accelerated Real-Time Imaging.

Ziwu Zhou,Fei Han,Vahid Ghodrati,Yu Gao,Wotao Yin,Yingli Yang,Peng Hu

DOI: https://doi.org/10.1002/mp.13628

2019-01-01

Abstract:Purpose To develop and evaluate a parallel imaging and convolutional neural network combined image reconstruction framework for low-latency and high-quality accelerated real-time MR imaging. Methods Conventional Parallel Imaging reconstruction resolved as gradient descent steps was compacted as network layers and interleaved with convolutional layers in a general convolutional neural network. All parameters of the network were determined during the offline training process, and applied to unseen data once learned. The proposed network was first evaluated for real-time cardiac imaging at 1.5 T and real-time abdominal imaging at 0.35 T, using threefold to fivefold retrospective undersampling for cardiac imaging and threefold retrospective undersampling for abdominal imaging. Then, prospective undersampling with fourfold acceleration was performed on cardiac imaging to compare the proposed method with standard clinically available GRAPPA method and the state-of-the-art L1-ESPIRiT method. Results Both retrospective and prospective evaluations confirmed that the proposed network was able to images with a lower noise level and reduced aliasing artifacts in comparison with the single-coil based and L1-ESPIRiT reconstructions for cardiac imaging at 1.5 T, and the GRAPPA and L1-ESPIRiT reconstructions for abdominal imaging at 0.35 T. Using the proposed method, each frame can be reconstructed in less than 100 ms, suggesting its clinical compatibility. Conclusion The proposed Parallel Imaging and convolutional neural network combined reconstruction framework is a promising technique that allows low-latency and high-quality real-time MR imaging.
CDF-Net: Cross-Domain Fusion Network for Accelerated MRI Reconstruction

Osvald Nitski,Sayan Nag,Chris McIntosh,Bo Wang

DOI: https://doi.org/10.1007/978-3-030-59713-9_41

2020-01-01

Abstract:Accurate reconstruction of accelerated Magnetic Resonance Imaging (MRI) would produce myriad clinical benefits including higher patient throughput and lower examination cost. Traditional approaches utilize statistical methods in the frequency domain combined with Inverse Discrete Fourier Transform (IDFT) to interpolate the under-sampled frequency domain (referred as k-space) and often result in large artifacts in spatial domain. Recent advances in deep learning-based methods for MRI reconstruction, albeit outperforming traditional methods, fail to incorporate raw coil data and spatial domain data in an end-to-end manner. In this paper, we introduce a cross-domain fusion network (CDF-Net), a neural network architecture that recreates high resolution MRI reconstructions from an under-sampled single-coil k-space by taking advantage of relationships in both the frequency and spatial domains while also having an awareness of which frequencies have been omitted. CDF-Net consists of three main components, a U-Net variant operating on the spatial domain, another U-Net performing inpainting in k-space, and a ‘frequency informed’ U-Net variant merging the two reconstructions as well as a skip connected zero-filled reconstruction. The proposed CDF-Net represents one of the first end-to-end MRI reconstruction network that leverages relationships in both k-space and the spatial domain with a novel ‘frequency information pathway’ that allows information about missing frequencies to flow into the spatial domain. Trained on the largest public fastMRI dataset, CDF-Net outperforms both traditional statistical interpolation and deep learning-based methods by a large margin.
DDC-Net: Dual-Domain Cascaded Network with POCS Prior for Fast MRI Reconstruction

Zhijie Wang,Aiping Liu,Jinbao Wei,Qingguo Xie,Kongqiao Wang,Xun Chen

DOI: https://doi.org/10.1109/jsen.2024.3366764

IF: 4.3

2024-01-01

IEEE Sensors Journal

Abstract:Magnetic resonance imaging (MRI) is a powerful diagnostic tool that provides high-resolution images, but it requires a time-consuming scanning procedure. To reduce the acquisition time, various methods have been proposed to reconstruct images from undersampled k-space. However, most dual-domain learning-based methods have two primary limitations: 1) using the same reconstruction network for different domains may hinder the learning of targeted information for each domain and 2) the reconstruction network uses only highly undersampled data as input, leaving the use of prior as complementary information highly underexplored. To alleviate the above issues, we propose a dual-domain cascaded network with projection onto convex set (POCS) prior for fast MRI, called DDC-Net. It consists of cascaded blocks with image-domain subnetwork (I-Net) and frequency-domain subnetwork (K-Net) reconstruction subnetworks. Specifically, the customized I-Net for the image domain uses a two-encoder-one-decoder architecture to enrich detailed structures. On the other hand, the customized K-Net for the frequency ( k-space) domain replaces the traditional encoder-decoder with a cross-domain encoder-decoder to alleviate the difficult modeling problem of k-space data. In addition, the POCS prior as complementary information is deeply embedded in the dual domain to simultaneously guide the k-space and image reconstructions. Extensive experiments on the fastMRI and CC359 datasets demonstrate that our proposed DDC-Net achieves state-of-the-art qualitative and quantitative reconstruction results, outperforming previous deep learning (DL)-based methods.
Dual-domain faster Fourier convolution based network for MR image reconstruction

Xiaohan Liu,Yanwei Pang,Yiming Liu,Ruiqi Jin,Yong Sun,Yu Liu,Jing Xiao

DOI: https://doi.org/10.1016/j.compbiomed.2024.108603

IF: 7.7

2024-05-23

Computers in Biology and Medicine

Abstract:Deep learning methods for fast MRI have shown promise in reconstructing high-quality images from undersampled multi-coil k -space data, leading to reduced scan duration. However, existing methods encounter challenges related to limited receptive fields in dual-domain ( k -space and image domains) reconstruction networks, rigid data consistency operations, and suboptimal refinement structures, which collectively restrict overall reconstruction performance. This study introduces a comprehensive framework that addresses these challenges and enhances MR image reconstruction quality. Firstly, we propose Faster Inverse Fourier Convolution (FasterIFC), a frequency domain convolutional operator that significantly expands the receptive field of k -space domain reconstruction networks. Expanding the information extraction range to the entire frequency spectrum according to the spectral convolution theorem in Fourier theory enables the network to easily utilize richer redundant long-range information from adjacent, symmetrical, and diagonal locations of multi-coil k -space data. Secondly, we introduce a novel softer Data Consistency (softerDC) layer, which achieves an enhanced balance between data consistency and smoothness. This layer facilitates the implementation of diverse data consistency strategies across distinct frequency positions, addressing the inflexibility observed in current methods. Finally, we present the Dual-Domain Faster Fourier Convolution Based Network (D2F2), which features a centrosymmetric dual-domain parallel structure based on FasterIFC. This architecture optimally leverages dual-domain data characteristics while substantially expanding the receptive field in both domains. Coupled with the softerDC layer, D2F2 demonstrates superior performance on the NYU fastMRI dataset at multiple acceleration factors, surpassing state-of-the-art methods in both quantitative and qualitative evaluations.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
DFUSNN: zero-shot dual-domain fusion unsupervised neural network for parallel MRI reconstruction

Shengyi Chen,Jizhong Duan,Xinmin Ren,Junfeng Wang,Yu Liu

DOI: https://doi.org/10.1088/1361-6560/ad3dbc

IF: 3.5

2024-04-13

Physics in Medicine and Biology

Abstract:Objective. Recently, deep learning models have been used to reconstruct parallel magnetic resonance (MR) images from undersampled k-space data. However, most existing approaches depend on large databases of fully sampled MR data for training, which can be challenging or sometimes infeasible to acquire in certain scenarios. The goal is to develop an effective alternative for improved reconstruction quality that does not rely on external training datasets. Approach. We introduce a novel zero-shot dual-domain fusion unsupervised neural network (DFUSNN) for parallel MR imaging reconstruction without any external training datasets. We employ the Noise2Noise (N2N) network for the reconstruction in the k-space domain, integrates phase and coil sensitivity smoothness priors into the k-space N2N network, and uses an early stopping criterion to prevent overfitting. Additionally, we propose a dual-domain fusion method based on Bayesian optimization to enhance reconstruction quality efficiently. Results. Simulation experiments conducted on three datasets with different undersampling patterns showed that the DFUSNN outperforms all other competing unsupervised methods and the one-shot Hankel-k-space generative model (HKGM). The DFUSNN also achieves comparable results to the supervised Deep-SLR method. Significance. The novel DFUSNN model offers a viable solution for reconstructing high quality MR images without the need for external training datasets, thereby overcoming a major hurdle in scenarios where acquiring fully sampled MR data is difficult.

engineering, biomedical,radiology, nuclear medicine & medical imaging
Multi-Modal Multi-Slice Cooperative Dual-Domain Cascaded De-Aliasing Network for MR Imaging Reconstruction

Xuebin Sun,Yanwei Pang,Yiming Liu,Caifeng Shan,Shing Shin Cheng

DOI: https://doi.org/10.1109/jbhi.2024.3413083

IF: 7.7

2024-01-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Recent advancements in Magnetic Resonance Imaging (MRI) reconstruction techniques aim to accelerate the imaging process. However, these methods still face two key limitations. Firstly, although the same location consistently provides anatomical information across different modalities, such as organs, tissues, or lesions, previous studies have predominantly relied on single-modality information, overlooking the potential advantages of incorporating complementary data from other modalities. Secondly, while adjacent MRI slices often capture the same location or organ with similar anatomical structures, only a few methods consider the information from neighboring slices during the reconstruction process. To address these challenges, we propose a M ulti-modal M ulti-slice cooperative D ual-domain cascaded de-alising network for MR imaging R econstruction (MMDR). Specifically, we design a multi-slice and multi-modal feature fusion network based on 3D convolution and swin transformer that efficiently extracts multi-modal features from MRI. Then, a dual domain cascaded recurrent network through dense-blocks with large receptive fields for fast MRI reconstruction is explored. Extensive experiments on the IXI datasets were carried out to evaluate the proposed method's robustness across varying network structures, under-sampling rates, and sampling patterns. MMDR demonstrates promising performance across both qualitative and quantitative metrics, particularly with a competitive PSNE of 42.15 and an SSIM of 0.984 for T2 reconstruction using 30% T2WI and PDWI, as well as achieving a PSNE of 39.92 and an SSIM of 0.966 for PDWI reconstruction with 30% PDWI and T2WI.
MD-Recon-Net: A Parallel Dual-Domain Convolutional Neural Network for Compressed Sensing MRI

Maosong Ran,Wenjun Xia,Yongqiang Huang,Zexin Lu,Peng Bao,Yan Liu,Huaiqiang Sun,Jiliu Zhou,Yi Zhang

DOI: https://doi.org/10.48550/arXiv.1910.10392

2020-05-18

Abstract:Compressed sensing magnetic resonance imaging (CS-MRI) is a theoretical framework that can accurately reconstruct images from undersampled k-space data with a much lower sampling rate than the one set by the classical Nyquist-Shannon sampling theorem. Therefore, CS-MRI can efficiently accelerate acquisition time and relieve the psychological burden on patients while maintaining high imaging quality. The problems with traditional CS-MRI reconstruction are solved by iterative numerical solvers, which usually suffer from expensive computational cost and the lack of accurate handcrafted priori. In this paper, inspired by deep learning's (DL's) fast inference and excellent end-to-end performance, we propose a novel cascaded convolutional neural network called MD-Recon-Net to facilitate fast and accurate MRI reconstruction. Especially, different from existing DL-based methods, which operate on single domain data or both domains in a certain order, our proposed MD-Recon-Net contains two parallel and interactive branches that simultaneously perform on k-space and spatial-domain data, exploring the latent relationship between k-space and the spatial domain. The simulated experimental results show that the proposed method not only achieves competitive visual effects to several state-of-the-art methods, but also outperforms other DL-based methods in terms of model scale and computational cost.

Medical Physics,Image and Video Processing
Benchmarking 3D multi-coil NC-PDNet MRI reconstruction

Asma Tanabene,Chaithya Giliyar Radhakrishna,Aurélien Massire,Mariappan S. Nadar,Philippe Ciuciu

2024-11-08

Abstract:Deep learning has shown great promise for MRI reconstruction from undersampled data, yet there is a lack of research on validating its performance in 3D parallel imaging acquisitions with non-Cartesian undersampling. In addition, the artifacts and the resulting image quality depend on the under-sampling pattern. To address this uncharted territory, we extend the Non-Cartesian Primal-Dual Network (NC-PDNet), a state-of-the-art unrolled neural network, to a 3D multi-coil setting. We evaluated the impact of channel-specific versus channel-agnostic training configurations and examined the effect of coil compression. Finally, we benchmark four distinct non-Cartesian undersampling patterns, with an acceleration factor of six, using the publicly available Calgary-Campinas dataset. Our results show that NC-PDNet trained on compressed data with varying input channel numbers achieves an average PSNR of 42.98 dB for 1 mm isotropic 32 channel whole-brain 3D reconstruction. With an inference time of 4.95sec and a GPU memory usage of 5.49 GB, our approach demonstrates significant potential for clinical research application.

Image and Video Processing,Computer Vision and Pattern Recognition
Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

Xiaohan Liu,Yanwei Pang,Xuebin Sun,Yiming Liu,Yonghong Hou,Zhenchang Wang,Xuelong Li

DOI: https://doi.org/10.1109/tip.2024.3388970

IF: 10.6

2024-04-27

IEEE Transactions on Image Processing

Abstract:High quality image reconstruction from undersampled -space data is key to accelerating MR scanning. Current deep learning methods are limited by the small receptive fields in reconstruction networks, which restrict the exploitation of long-range information, and impede the mitigation of full-image artifacts, particularly in 3D reconstruction tasks. Additionally, the substantial computational demands of 3D reconstruction considerably hinder advancements in related fields. To tackle these challenges, we propose the following: 1) A novel convolution operator named Faster Fourier Convolution (FasterFC), aims at providing an adaptable broad receptive field for spatial domain reconstruction networks with fast computational speed. 2) A split-slice strategy that substantially reduces the computational load of 3D reconstruction, enabling high-resolution, multi-coil, 3D MR image reconstruction while fully utilizing inter-layer and intra-layer information. 3) A single-to-group algorithm that efficiently utilizes scan-specific and data-driven priors to enhance -space interpolation effects. 4) A multi-stage, multi-coil, 3D fast MRI method, called the faster Fourier convolution based single-to-group network (FAS-Net), comprising a single-to-group -space interpolation algorithm and a FasterFC-based image domain reconstruction module, significantly minimizes the computational demands of 3D reconstruction through split-slice strategy. Experimental evaluations conducted on the NYU fastMRI and Stanford MRI Data datasets reveal that the FasterFC significantly enhances the quality of both 2D and 3D reconstruction results. Moreover, FAS-Net, characterized as a method that can achieve high-resolution (320, 320, 256), multi-coil, (8 coils), 3D fast MRI, exhibits superior reconstruction performance compared to other state-of-the-art 2D and 3D methods.

computer science, artificial intelligence,engineering, electrical & electronic
DD-CISENet: Dual-Domain Cross-Iteration Squeeze and Excitation Network for Accelerated MRI Reconstruction

Xiongchao Chen,Zhigang Peng,Gerardo Hermosillo Valadez

2023-04-29

Abstract:Magnetic resonance imaging (MRI) is widely employed for diagnostic tests in neurology. However, the utility of MRI is largely limited by its long acquisition time. Acquiring fewer k-space data in a sparse manner is a potential solution to reducing the acquisition time, but it can lead to severe aliasing reconstruction artifacts. In this paper, we present a novel Dual-Domain Cross-Iteration Squeeze and Excitation Network (DD-CISENet) for accelerated sparse MRI reconstruction. The information of k-spaces and MRI images can be iteratively fused and maintained using the Cross-Iteration Residual connection (CIR) structures. This study included 720 multi-coil brain MRI cases adopted from the open-source fastMRI Dataset. Results showed that the average reconstruction error by DD-CISENet was 2.28 $\pm$ 0.57%, which outperformed existing deep learning methods including image-domain prediction (6.03 $\pm$ 1.31, p < 0.001), k-space synthesis (6.12 $\pm$ 1.66, p < 0.001), and dual-domain feature fusion approaches (4.05 $\pm$ 0.88, p < 0.001).

Image and Video Processing,Computer Vision and Pattern Recognition
Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network

Junwei Yang,Pietro Liò

2023-12-01

Abstract:Purpose: To develop an efficient dual-domain reconstruction framework for multi-contrast MRI, with the focus on minimising cross-contrast misalignment in both the image and the frequency domains to enhance optimisation. Theory and Methods: Our proposed framework, based on deep learning, facilitates the optimisation for under-sampled target contrast using fully-sampled reference contrast that is quicker to acquire. The method consists of three key steps: 1) Learning to synthesise data resembling the target contrast from the reference contrast; 2) Registering the multi-contrast data to reduce inter-scan motion; and 3) Utilising the registered data for reconstructing the target contrast. These steps involve learning in both domains with regularisation applied to ensure their consistency. We also compare the reconstruction performance with existing deep learning-based methods using a dataset of brain MRI scans. Results: Extensive experiments demonstrate the superiority of our proposed framework, for up to an 8-fold acceleration rate, compared to state-of-the-art algorithms. Comprehensive analysis and ablation studies further present the effectiveness of the proposed components. Conclusion:Our dual-domain framework offers a promising approach to multi-contrast MRI reconstruction. It can also be integrated with existing methods to further enhance the reconstruction.

Image and Video Processing,Computer Vision and Pattern Recognition
Pyramid Convolutional RNN for MRI Image Reconstruction

Eric Z. Chen,Puyang Wang,Xiao Chen,Terrence Chen,Shanhui Sun

DOI: https://doi.org/10.48550/arXiv.1912.00543

2022-02-22

Abstract:Fast and accurate MRI image reconstruction from undersampled data is crucial in clinical practice. Deep learning based reconstruction methods have shown promising advances in recent years. However, recovering fine details from undersampled data is still challenging. In this paper, we introduce a novel deep learning based method, Pyramid Convolutional RNN (PC-RNN), to reconstruct images from multiple scales. Based on the formulation of MRI reconstruction as an inverse problem, we design the PC-RNN model with three convolutional RNN (ConvRNN) modules to iteratively learn the features in multiple scales. Each ConvRNN module reconstructs images at different scales and the reconstructed images are combined by a final CNN module in a pyramid fashion. The multi-scale ConvRNN modules learn a coarse-to-fine image reconstruction. Unlike other common reconstruction methods for parallel imaging, PC-RNN does not employ coil sensitive maps for multi-coil data and directly model the multiple coils as multi-channel inputs. The coil compression technique is applied to standardize data with various coil numbers, leading to more efficient training. We evaluate our model on the fastMRI knee and brain datasets and the results show that the proposed model outperforms other methods and can recover more details. The proposed method is one of the winner solutions in the 2019 fastMRI competition.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
DD-SSUN: A Dual-domain Self-supervised Unrolled Network for MRI Reconstruction

Kangkang Liu,Xiaohan Hao,Mengdie Song,Lei Guo,Bensheng Qiu

DOI: https://doi.org/10.1109/cisat62382.2024.10695341

2024-01-01

Abstract:In recent years, deep learning algorithms have been widely used in magnetic resonance image (MRI) reconstruction. However, existing algorithms have limitations such as difficulty in extracting effective features from undersampled data, serious loss of phase encoding information in K-domain data, and insufficient utilization of dual-domain features. This paper proposes a new MRI reconstruction network, namely the dual-domain self-supervised unrolling network (DD-SSUN). This approach performs feature learning and reconstruction simultaneously in both the image domain and k-space, leveraging the unique features of each domain. Additionally, self-supervised learning extracts valuable information from large amounts of unlabeled data, eliminating the need for fully sampled images and enhancing the reconstruction model’s generalization ability and robustness. The effectiveness of the proposed method is evaluated using the IXI brain dataset. Both qualitative and quantitative results demonstrate that the proposed method achieves high-speed reconstructions at acceleration ratios of 4 and 8. Furthermore, the proposed model surpasses other dual-domain self-supervised models and significantly outperforms traditional supervised learning methods in terms of reconstruction quality.
Joint Under-Sampling Pattern and Dual-Domain Reconstruction for Accelerating Multi-Contrast MRI

Pengcheng Lei,Le Hu,Faming Fang,Guixu Zhang

DOI: https://doi.org/10.1109/TIP.2024.3445729

2024-08-23

Abstract:Multi-Contrast Magnetic Resonance Imaging (MCMRI) utilizes the short-time reference image to facilitate the reconstruction of the long-time target one, providing a new solution for fast MRI. Although various methods have been proposed, they still have certain limitations. (1) Existing methods featuring the preset under-sampling patterns give rise to redundancy between multi-contrast images and limit their model performance. (2) Most methods focus on the information in the image domain, prior knowledge in the k-space domain has not been fully explored. (3) Most networks are manually designed and lack certain physical interpretability. To address these issues, we propose a joint optimization of the under-sampling pattern and a deep-unfolding dual-domain network for accelerating MCMRI. Firstly, to reduce the redundant information and sample more contrast-specific information, we propose a new framework to learn the optimal under-sampling pattern for MCMRI. Secondly, a dual-domain model is established to reconstruct the target image in both the image domain and the k-space frequency domain. The model in the image domain introduces a spatial transformation to explicitly model the inconsistent and unaligned structures of MCMRI. The model in the k-space learns prior knowledge from the frequency domain, enabling the model to capture more global information from the input images. Thirdly, we employ the proximal gradient algorithm to optimize the proposed model and then unfold the iterative results into a deep-unfolding network, called MC-DuDoN. We evaluate the proposed MC-DuDoN on MCMRI super-resolution and reconstruction tasks. Experimental results give credence to the superiority of the current model. In particular, since our approach explicitly models the inconsistent structures, it shows robustness on spatially misaligned MCMRI. In the reconstruction task, compared with conventional masks, the learned mask restores more realistic images, even under an ultra-high acceleration ratio (×30). Code is available at https://github.com/lpcccc-cv/MC-DuDoNet.
MLMFNet: A Multi-Level Modality Fusion Network for Multi-Modal Accelerated MRI Reconstruction

Xiuyun Zhou,Zhenxi Zhang,Hongwei Du,Bensheng Qiu

DOI: https://doi.org/10.1016/j.mri.2024.04.028

IF: 3.13

2024-01-01

Magnetic Resonance Imaging

Abstract:Magnetic resonance imaging produces detailed anatomical and physiological images of the human body that can be used in the clinical diagnosis and treatment of diseases. However, MRI suffers its comparatively longer acquisition time than other imaging methods and is thus vulnerable to motion artifacts, which ultimately lead to likely failed or even wrong diagnosis. In order to perform faster reconstruction, deep learning-based methods along with traditional strategies such as parallel imaging and compressed sensing come into play in recent years in this field. Meanwhile, in order to better analyze the diseases, it is also often necessary to acquire images in the same region of interest under different modalities, which yield images with different contrast levels. However, most of these aforementioned methods tend to use single-modal images for reconstruction, neglecting the correlation and redundancy information embedded in MR images acquired with different modalities. While there are works on multi-modal reconstruction, the information is yet to be efficiently explored. In this paper, we propose an end-to-end neural network called MLMFNet, which helps the reconstruction of the target modality by using information from the auxiliary modality across feature channels and layers. Specifically, this is highlighted by three components: (I) An encoder based on UNet with a single-stream strategy that fuses auxiliary and target modalities; (II) a decoder that tends to multi-level features from all layers of the encoder, and (III) a channel attention module. Quantitative and qualitative analyses are performed on a public brain dataset and knee brain dataset, which show that the proposed method achieves satisfying results in MRI reconstruction within the multi-modal context, and also demonstrate its effectiveness and potential to be used in clinical practice.
IKWI-net: A cross-domain convolutional neural network for undersampled magnetic resonance image reconstruction

Zhilun Wang,Haitao Jiang,Hongwei Du,Jinzhang Xu,Bensheng Qiu

DOI: https://doi.org/10.1016/j.mri.2020.06.015

IF: 3.13

2020-01-01

Magnetic Resonance Imaging

Abstract:Magnetic resonance imaging (MRI) is widely used to get the information of anatomical structure and physiological function with the advantages of high resolution and non-invasive scanning. But the long acquisition time limits its application. To reduce the time consumption of MRI, compressed sensing (CS) theory has been proposed to reconstruct MRI images from undersampled k-space data. But conventional CS methods mostly use iterative methods that take lots of time. Recently, deep learning methods are proposed to achieve faster reconstruction, but most of them only pay attention to a single domain, such as the image domain or k-space. To take advantage of the feature representation in different domains, we propose a cross-domain method based on deep learning, which first uses convolutional neural networks (CNNs) in the image domain, k-space and wavelet domain simultaneously. The combined order of the three domains is also first studied in this work, which has a significant effect on reconstruction. The proposed IKWI-net achieves the best performance in various combinations, which utilizes CNNs in the image domain, k-space, wavelet domain and image domain sequentially. Compared with several deep learning methods, experiments show it also achieves mean improvements of 0.91 dB in peak signal-to-noise ratio (PSNR) and 0.005 in structural similarity (SSIM).
A Hybrid Frequency-domain/Image-domain Deep Network for Magnetic Resonance Image Reconstruction

Roberto Souza,Richard Frayne

DOI: https://doi.org/10.48550/arXiv.1810.12473

2018-10-30

Abstract:Decreasing magnetic resonance (MR) image acquisition times can potentially reduce procedural cost and make MR examinations more accessible. Compressed sensing (CS)-based image reconstruction methods, for example, decrease MR acquisition time by reconstructing high-quality images from data that were originally sampled at rates inferior to the Nyquist-Shannon sampling theorem. In this work we propose a hybrid architecture that works both in the k-space (or frequency-domain) and the image (or spatial) domains. Our network is composed of a complex-valued residual U-net in the k-space domain, an inverse Fast Fourier Transform (iFFT) operation, and a real-valued U-net in the image domain. Our experiments demonstrated, using MR raw k-space data, that the proposed hybrid approach can potentially improve CS reconstruction compared to deep-learning networks that operate only in the image domain. In this study we compare our method with four previously published deep neural networks and examine their ability to reconstruct images that are subsequently used to generate regional volume estimates. We evaluated undersampling ratios of 75% and 80%. Our technique was ranked second in the quantitative analysis, but qualitative analysis indicated that our reconstruction performed the best in hard to reconstruct regions, such as the cerebellum. All images reconstructed with our method were successfully post-processed, and showed good volumetry agreement compared with the fully sampled reconstruction measures.

Image and Video Processing,Machine Learning,Signal Processing

Comparison of pore-forming ability in membranes of a native and a recombinant variant of Sticholysin II from Stichodactyla helianthus.

Deep Fusion Network Based Sparse View CT Reconstructions for Clinical Diagnostic Scanners

DCT-net: Dual-domain cross-fusion transformer network for MRI reconstruction

Parallel Imaging and Convolutional Neural Network Combined Fast MR Image Reconstruction: Applications in Low-Latency Accelerated Real-Time Imaging.

CDF-Net: Cross-Domain Fusion Network for Accelerated MRI Reconstruction

DDC-Net: Dual-Domain Cascaded Network with POCS Prior for Fast MRI Reconstruction

Dual-domain faster Fourier convolution based network for MR image reconstruction

DFUSNN: zero-shot dual-domain fusion unsupervised neural network for parallel MRI reconstruction

Multi-Modal Multi-Slice Cooperative Dual-Domain Cascaded De-Aliasing Network for MR Imaging Reconstruction

MD-Recon-Net: A Parallel Dual-Domain Convolutional Neural Network for Compressed Sensing MRI

Benchmarking 3D multi-coil NC-PDNet MRI reconstruction

Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

DD-CISENet: Dual-Domain Cross-Iteration Squeeze and Excitation Network for Accelerated MRI Reconstruction

Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network

Pyramid Convolutional RNN for MRI Image Reconstruction

DD-SSUN: A Dual-domain Self-supervised Unrolled Network for MRI Reconstruction

Joint Under-Sampling Pattern and Dual-Domain Reconstruction for Accelerating Multi-Contrast MRI

MLMFNet: A Multi-Level Modality Fusion Network for Multi-Modal Accelerated MRI Reconstruction

IKWI-net: A cross-domain convolutional neural network for undersampled magnetic resonance image reconstruction

A Hybrid Frequency-domain/Image-domain Deep Network for Magnetic Resonance Image Reconstruction