A miniaturized membrane inlet mass spectrometry interface for analysis of nitric oxide in human plasma.

E. Trushina,N. J. Clarke,L. Benson,A. Tomlinson,C. McMurray,Stephen Naylor

DOI: https://doi.org/10.1002/(SICI)1097-0231(19980731)12:14<985::AID-RCM266>3.0.CO;2-7

IF: 2.586

1998-07-31

Rapid Communications in Mass Spectrometry

Abstract:

What problem does this paper attempt to address?

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling

Guangyuan Li,Lei Zhao,Jiakai Sun,Zehua Lan,Zhanjie Zhang,Jiafu Chen,Zhijie Lin,Huaizhong Lin,Wei Xing

DOI: https://doi.org/10.1109/iccv51070.2023.01941

2023-01-01

Abstract:Recently, several methods have explored the potential of multi-contrast magnetic resonance imaging (MRI) super-resolution (SR) and obtain results superior to single-contrast SR methods. However, existing approaches still have two shortcomings: (1) They can only address fixed integer upsampling scales, such as 2×, 3×, and 4×, which require training and storing the corresponding model separately for each upsampling scale in clinic. (2) They lack direct interaction among different windows as they adopt the square window (e.g., 8×8) transformer network architecture, which results in inadequate modelling of longer-range dependencies. Moreover, the relationship between reference images and target images is not fully mined. To address these issues, we develop a novel network for multi-contrast MRI arbitrary-scale SR, dubbed as McASSR. Specifically, we design a rectangle-window cross-attention transformer to establish longer-range dependencies in MR images without increasing computational complexity and fully use reference information. Besides, we propose the reference-aware implicit attention as an upsampling module, achieving arbitrary-scale super-resolution via implicit neural representation, further fusing supplementary information of the reference image. Extensive and comprehensive experiments on both public and clinical datasets show that our McASSR yields superior performance over SOTA methods, demonstrating its great potential to be applied in clinical practice. Code will be available at https://github.com/GuangYuanKK/McASSR.
Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Yimin Ma,Yi Xu,Yunqing Liu,Fei Yan,Qiong Zhang,Qi Li,Quanyang Liu

DOI: https://doi.org/10.3390/app14062634

2024-01-01

Abstract:In recent years, deep convolutional neural networks with multi-scale features have been widely used in image super-resolution reconstruction (ISR), and the quality of the generated images has been significantly improved compared with traditional methods. However, in current image super-resolution network algorithms, these methods need to be further explored in terms of the effective fusion of multi-scale features and cross-domain application of attention mechanisms. To address these issues, we propose a novel multi-scale cross-attention fusion network (MCFN), which optimizes the feature extraction and fusion process in structural design and modular innovation. In order to make better use of the attention mechanism, we propose a Pyramid Multi-scale Module (PMM) to extract multi-scale information by cascading. This PMM is introduced in MCFN and is mainly constructed by multiple multi-scale cross-attention modules (MTMs). To fuse the feature information of PMMs efficiently in both channel and spatial dimensions, we propose the cross-attention fusion module (CFM). In addition, an improved integrated attention enhancement module (IAEM) is inserted at the network’s end to enhance the correlation of high-frequency feature information between layers. Experimental results show that the algorithm significantly improves the reconstructed images’ edge information and texture details, and the benchmark dataset’s performance evaluation shows comparable performance to current state-of-the-art techniques.
DuDoINet: Dual-Domain Implicit Network for Multi-Modality MR Image Arbitrary-scale Super-Resolution

Guangyuan Li,Wei Xing,Lei Zhao,Zehua Lan,Zhanjie Zhang,Jiakai Sun,Haolin Yin,Huaizhong Lin,Zhijie Lin

DOI: https://doi.org/10.1145/3581783.3612230

2023-01-01

Abstract:Compared to single-modality magnetic resonance (MR) image super-resolution (SR) methods, multi-modality MR image methods can utilize high-resolution reference modality (e.g., T1 modality) to provide valuable complementary information for low-resolution target modality (e.g., T2 modality) in SR reconstruction, which can further improve the quality of the SR images. Although they have achieved impressive results, these methods still suffer from the following drawbacks: (1) They can only handle fixed integer upsampling factors, such as 2X, 3X, and 4X, and require training and storing corresponding models for each upsampling factor, which is infeasible in clinical practice; (2) They only perform feature extraction and reconstruction in the image domain. However, the aliasing artifacts produced in the image domain are structural and non-local. Therefore, using only the image domain cannot effectively reconstruct high-quality aliasing-free SR images. To address these issues, we develop a brand-new Dual-Domain Implicit Network (DuDoINet) for multi-modality MR image arbitrary-scale SR. Specifically, we propose a dual-domain learning scheme for multi-modality MR image SR, which allows the network to sufficiently exploit the frequency and image domain information in MR images. In addition, we design implicit attention to achieve arbitrary-scale upsampling of MR images, which utilizes a continuously differentiable function that generates pixel values from pixel coordinates. Furthermore, we designed a deformable cross-modality attention mechanism that can adaptively transfer high-frequency details from the T1 to the T2 modality, better integrating valuable complementary information from the T1 modality. Extensive and comprehensive experiments on healthy subjects and patient datasets demonstrate that our DuDoINet outperforms SOTA methods, demonstrating its great potential for clinical practice.
Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Xinyu Wang,Jing Zhang

DOI: https://doi.org/10.54097/fcis.v2i1.2486

2022-01-01

Abstract:Single image super-resolution reconstruction (SISR) is one of the important techniques in computer vision and image processing. Most of the existing SISR methods adopt equal processing for different spatial domains and channel domains, resulting in a large amount of computational resources wasted on unimportant features. In order to address these problems, a novel lightweight multi-attention fusion network (LMAFN) is proposed, in which the multiple attention fusion block allocates computational resources more efficiently by capturing the weight information implied by the channel domain and the spatial domain separately, thus effectively reducing the number of parameters. The synthetic channel attention block in the multiple attention fusion block makes full use of inter-channel correlation by introducing both global standard deviation pooling and maximum pooling. Global features are fused through residual linking to alleviate the problem of high frequency information loss. Experimental results on several benchmark datasets show that the proposed method effectively reduces the number of parameters and computational effort without excessive loss of reconstruction performance, and achieves better performance than the compared models.
Multicontrast MRI Super-Resolution Via Transformer-Empowered Multiscale Contextual Matching and Aggregation.

Jun Lyu,Guangyuan Li,Chengyan Wang,Qing Cai,Qi Dou,David Zhang,Jing Qin

DOI: https://doi.org/10.1109/tnnls.2023.3250491

IF: 14.255

2023-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Magnetic resonance imaging (MRI) possesses the unique versatility to acquire images under a diverse array of distinct tissue contrasts, which makes multicontrast super-resolution (SR) techniques possible and needful. Compared with single-contrast MRI SR, multicontrast SR is expected to produce higher quality images by exploiting a variety of complementary information embedded in different imaging contrasts. However, existing approaches still have two shortcomings: 1) most of them are convolution-based methods and, hence, weak in capturing long-range dependencies, which are essential for MR images with complicated anatomical patterns and 2) they ignore to make full use of the multicontrast features at different scales and lack effective modules to match and aggregate these features for faithful SR. To address these issues, we develop a novel multicontrast MRI SR network via transformer-empowered multiscale feature matching and aggregation, dubbed McMRSR ++ . First, we tame transformers to model long-range dependencies in both reference and target images at different scales. Then, a novel multiscale feature matching and aggregation method is proposed to transfer corresponding contexts from reference features at different scales to the target features and interactively aggregate them. Furthermore, a texture-preserving branch and a contrastive constraint are incorporated into our framework for enhancing the textural details in the SR images. Experimental results on both public and clinical in vivo datasets show that McMRSR ++ outperforms state-of-the-art methods under peak signal to noise ratio (PSNR), structure similarity index measure (SSIM), and root mean square error (RMSE) metrics significantly. Visual results demonstrate the superiority of our method in restoring structures, demonstrating its great potential to improve scan efficiency in clinical practice.
Multi-contrast High Quality MR Image Super-Resolution with Dual Domain Knowledge Fusion

Runhan Wang,Ruiwei Zhao,Weijia Fu,Xiaobo Zhang,Yuejie Zhang,Rui Feng

DOI: https://doi.org/10.1109/bibm55620.2022.9995219

2022-01-01

Abstract:Multi-contrast high quality high-resolution (HR) Magnetic Resonance (MR) images enrich available information for diagnosis and analysis. Deep convolutional neural network methods have shown promising ability for MR image super-resolution (SR) given low-resolution (LR) MR images. Methods taking HR images as references (Ref) have made progress to enhance the effect of MR images SR. However, existing multi-contrast MR image SR approaches are based on contrasting-expanding backbones, which lose high frequency information of Ref image during downsampling. They also failed to transfer textures of Ref image into target domain. In this paper, we propose Edge Mask Transformer UNet (EMFU) for accelerating MR images SR. We propose Edge Mask Transformer (EMF) to generate global details and texture representation of target domain. Dual domain fusion module in UNet aggregates semantic information of the representation and LR image of target domain. Specifically, we extract and encode edge masks to guide the attention in EMF by re-distributing the embedding tensors, so that the network allocates more attention to image edge area. We also design a dual domain fusion module with self-attention and cross-attention to deeply fuse semantic information of multiple protocols for MRI. Extensive experiments show the effectiveness of our proposed EMFU, which surpasses state-of-the-art methods on benchmarks quantitatively and visually. Codes will be released to the community.
Compound Attention and Neighbor Matching Network for Multi-contrast MRI Super-resolution

Wenxuan Chen,Sirui Wu,Shuai Wang,Zhongsen Li,Jia Yang,Huifeng Yao,Xiaolei Song

2023-09-17

Abstract:Multi-contrast magnetic resonance imaging (MRI) reflects information about human tissue from different perspectives and has many clinical applications. By utilizing the complementary information among different modalities, multi-contrast super-resolution (SR) of MRI can achieve better results than single-image super-resolution. However, existing methods of multi-contrast MRI SR have the following shortcomings that may limit their performance: First, existing methods either simply concatenate the reference and degraded features or exploit global feature-matching between them, which are unsuitable for multi-contrast MRI SR. Second, although many recent methods employ transformers to capture long-range dependencies in the spatial dimension, they neglect that self-attention in the channel dimension is also important for low-level vision tasks. To address these shortcomings, we proposed a novel network architecture with compound-attention and neighbor matching (CANM-Net) for multi-contrast MRI SR: The compound self-attention mechanism effectively captures the dependencies in both spatial and channel dimension; the neighborhood-based feature-matching modules are exploited to match degraded features and adjacent reference features and then fuse them to obtain the high-quality images. We conduct experiments of SR tasks on the IXI, fastMRI, and real-world scanning datasets. The CANM-Net outperforms state-of-the-art approaches in both retrospective and prospective experiments. Moreover, the robustness study in our work shows that the CANM-Net still achieves good performance when the reference and degraded images are imperfectly registered, proving good potential in clinical applications.

Image and Video Processing,Computer Vision and Pattern Recognition
Cross-contrast mutual fusion network for joint MRI reconstruction and super-resolution

Yue Ding,Tao Zhou,Lei Xiang,Ye Wu

DOI: https://doi.org/10.1016/j.patcog.2024.110599

IF: 8

2024-05-19

Pattern Recognition

Abstract:Magnetic Resonance Imaging (MRI) is a widely used medical imaging technique that has become an essential tool for diagnosing various diseases and visualizing internal structures and tissues in the human body. MRI reconstruction and super-resolution are two techniques that can enhance image quality and accelerate the imaging process. However, current methods perform these tasks independently and fail to consider the correlations between them. Additionally, multi-contrast SR methods typically concatenate features from different contrasts without considering their correlation. In this paper, we propose a novel Cross-contrast Mutual Fusion Network (CMF-Net) that performs joint MRI reconstruction and super-resolution by enabling mutual propagation of feature representations between the two tasks. The CMF-Net framework consists of two stages: the first stage focuses on fusing multi-contrast features, while the second stage aims to learn task-specific information for joint MRI reconstruction and super-resolution. We propose a Multi-contrast Feature Aggregation (MFA) module to facilitate the integration of multi-contrast features. This module captures multi-scale information from auxiliary contrast to enhance the feature representation's capability. Furthermore, a Multi-task Mutual Fusion (MMF) module is presented to integrate task-specific features, which explores the correlation between the two tasks to improve MR super-resolution performance. We evaluate the proposed CMF-Net approach on two public MR datasets. Quantitative and qualitative results demonstrate that our CMF-Net outperforms other state-of-the-art methods.

computer science, artificial intelligence,engineering, electrical & electronic
Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution

Guangyuan Li,Jun Lv,Yapeng Tian,Qi Dou,Chengyan Wang,Chenliang Xu,Jing Qin

DOI: https://doi.org/10.1109/cvpr52688.2022.01998

2022-01-01

Abstract:Magnetic resonance imaging (MRI) can present multi-contrast images of the same anatomical structures, enabling multi-contrast super-resolution (SR) techniques. Compared with SR reconstruction using a single-contrast, multi-contrast SR reconstruction is promising to yield SR images with higher quality by leveraging diverse yet complementary information embedded in different imaging modalities. However, existing methods still have two shortcomings: (1) they neglect that the multi-contrast features at different scales contain different anatomical details and hence lack effective mechanisms to match and fuse these features for better reconstruction; and (2) they are still deficient in capturing long-range dependencies, which are essential for the regions with complicated anatomical structures. We propose a novel network to comprehensively address these problems by developing a set of innovative Transformer-empowered multi-scale contextual matching and aggregation techniques; we call it McMRSR. Firstly, we tame transformers to model long-range dependencies in both reference and target images. Then, a new multi-scale contextual matching method is proposed to capture corresponding contexts from reference features at different scales. Furthermore, we introduce a multi-scale aggregation mechanism to gradually and interactively aggregate multi-scale matched features for reconstructing the target SR MR image. Extensive experiments demonstrate that our network outperforms state-of-the-art approaches and has great potential to be applied in clinical practice. Codes are available at https://github.com/XAIMI-Lab/McMRSR.
Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI

Jiamiao Zhang,Yichen Chi,Jun Lyu,Wenming Yang,Yapeng Tian

2023-07-10

Abstract:Limited by imaging systems, the reconstruction of Magnetic Resonance Imaging (MRI) images from partial measurement is essential to medical imaging research. Benefiting from the diverse and complementary information of multi-contrast MR images in different imaging modalities, multi-contrast Super-Resolution (SR) reconstruction is promising to yield SR images with higher quality. In the medical scenario, to fully visualize the lesion, radiologists are accustomed to zooming the MR images at arbitrary scales rather than using a fixed scale, as used by most MRI SR methods. In addition, existing multi-contrast MRI SR methods often require a fixed resolution for the reference image, which makes acquiring reference images difficult and imposes limitations on arbitrary scale SR tasks. To address these issues, we proposed an implicit neural representations based dual-arbitrary multi-contrast MRI super-resolution method, called Dual-ArbNet. First, we decouple the resolution of the target and reference images by a feature encoder, enabling the network to input target and reference images at arbitrary scales. Then, an implicit fusion decoder fuses the multi-contrast features and uses an Implicit Decoding Function~(IDF) to obtain the final MRI SR results. Furthermore, we introduce a curriculum learning strategy to train our network, which improves the generalization and performance of our Dual-ArbNet. Extensive experiments in two public MRI datasets demonstrate that our method outperforms state-of-the-art approaches under different scale factors and has great potential in clinical practice.

Image and Video Processing,Computer Vision and Pattern Recognition
SGSR: Structure-Guided Multi-Contrast MRI Super-Resolution via Spatio-Frequency Co-Query Attention

Shaoming Zheng,Yinsong Wang,Siyi Du,Chen Qin

2024-08-06

Abstract:Magnetic Resonance Imaging (MRI) is a leading diagnostic modality for a wide range of exams, where multiple contrast images are often acquired for characterizing different tissues. However, acquiring high-resolution MRI typically extends scan time, which can introduce motion artifacts. Super-resolution of MRI therefore emerges as a promising approach to mitigate these challenges. Earlier studies have investigated the use of multiple contrasts for MRI super-resolution (MCSR), whereas majority of them did not fully exploit the rich contrast-invariant structural information. To fully utilize such crucial prior knowledge of multi-contrast MRI, in this work, we propose a novel structure-guided MCSR (SGSR) framework based on a new spatio-frequency co-query attention (CQA) mechanism. Specifically, CQA performs attention on features of multiple contrasts with a shared structural query, which is particularly designed to extract, fuse, and refine the common structures from different contrasts. We further propose a novel frequency-domain CQA module in addition to the spatial domain, to enable more fine-grained structural refinement. Extensive experiments on fastMRI knee data and low-field brain MRI show that SGSR outperforms state-of-the-art MCSR methods with statistical significance.

Image and Video Processing,Computer Vision and Pattern Recognition
MAPANet: A Multi-Scale Attention-Guided Progressive Aggregation Network for Multi-Contrast MRI Super-Resolution

Licheng Liu,Tao Liu,Wei Zhou,Yaonan Wang,Min Liu

DOI: https://doi.org/10.1109/tci.2024.3393723

IF: 5.4

2024-06-14

IEEE Transactions on Computational Imaging

Abstract:Multi-contrast magnetic resonance imaging (MRI) super-resolution (SR), which utilizes complementary information from different contrast images to reconstruct the target images, can provide rich information for quantitative image analysis and accurate medical diagnosis. However, the current mainstream methods are failed in exploiting multi-scale features or global information for data representation, leading to poor outcomes. To address these limitations, we propose a multi-scale attention-guided progressive aggregation network (MAPANet) to progressively restore the target contrast MR images from the corresponding low resolution (LR) observations with the assistance of auxiliary contrast images. Specifically, the proposed MAPANet is composed of several stacked dual-branch aggregation (DBA) blocks, each of which consists of two parallel modules: the multi-scale attention module (MSAM) and the reference feature extraction module (RFEM). The former aims to utilize multi-scale and appropriate non-local information to facilitate the SR reconstruction, while the latter is designed to extract the complementary information from auxiliary contrast images to assist in restoring edge structures and details for target contrast images. Extensive experiments on the public datasets demonstrate that the proposed MAPANet outperforms several state-of-the-art multi-contrast SR methods.

engineering, electrical & electronic,imaging science & photographic technology
Edge-guided and Cross-scale Feature Fusion Network for Efficient Multi-contrast MRI Super-Resolution

Zhiyuan Yang,Bo Zhang,Zhiqiang Zeng,Si Yong Yeo

2024-08-25

Abstract:In recent years, MRI super-resolution techniques have achieved great success, especially multi-contrast methods that extract texture information from reference images to guide the super-resolution reconstruction. However, current methods primarily focus on texture similarities at the same scale, neglecting cross-scale similarities that provide comprehensive information. Moreover, the misalignment between features of different scales impedes effective aggregation of information flow. To address the limitations, we propose a novel edge-guided and cross-scale feature fusion network, namely ECFNet. Specifically, we develop a pipeline consisting of the deformable convolution and the cross-attention transformer to align features of different scales. The cross-scale fusion strategy fully integrates the texture information from different scales, significantly enhancing the super-resolution. In addition, a novel structure information collaboration module is developed to guide the super-resolution reconstruction with implicit structure priors. The structure information enables the network to focus on high-frequency components of the image, resulting in sharper details. Extensive experiments on the IXI and BraTS2020 datasets demonstrate that our method achieves state-of-the-art performance compared to other multi-contrast MRI super-resolution methods, and our method is robust in terms of different super-resolution scales. We would like to release our code and pre-trained model after the paper is accepted.

Image and Video Processing
Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network

Junwei Yang,Pietro Liò

2023-12-01

Abstract:Purpose: To develop an efficient dual-domain reconstruction framework for multi-contrast MRI, with the focus on minimising cross-contrast misalignment in both the image and the frequency domains to enhance optimisation. Theory and Methods: Our proposed framework, based on deep learning, facilitates the optimisation for under-sampled target contrast using fully-sampled reference contrast that is quicker to acquire. The method consists of three key steps: 1) Learning to synthesise data resembling the target contrast from the reference contrast; 2) Registering the multi-contrast data to reduce inter-scan motion; and 3) Utilising the registered data for reconstructing the target contrast. These steps involve learning in both domains with regularisation applied to ensure their consistency. We also compare the reconstruction performance with existing deep learning-based methods using a dataset of brain MRI scans. Results: Extensive experiments demonstrate the superiority of our proposed framework, for up to an 8-fold acceleration rate, compared to state-of-the-art algorithms. Comprehensive analysis and ablation studies further present the effectiveness of the proposed components. Conclusion:Our dual-domain framework offers a promising approach to multi-contrast MRI reconstruction. It can also be integrated with existing methods to further enhance the reconstruction.

Image and Video Processing,Computer Vision and Pattern Recognition
Multi-Contrast MRI Reconstruction Based on Frequency Domain Separation and Cross-Self-Attention

Yiran Qiu,Haotian Zhang,Qiaoyu Ma,Guangsong Yang,Zongying Lai

DOI: https://doi.org/10.1109/access.2024.3388379

IF: 3.9

2024-04-30

IEEE Access

Abstract:Multi-contrast magnetic resonance imaging can bring convenience to medical diagnosis and decision-making. However, due to the long acquisition time, the images are easily disturbed by motion artifacts. To accelerate MRI, the approach of under-sampling k-space data has been used. This approach leads to the deterioration of MR image quality. To restore images, we proposed a Residual Convolution Swin Transformer Block (RCSTB), which includes local feature representation in a convolutional neural network module and global long-term feature extraction in the transformer. Additionally, similarities reflected by structure information in high frequency among multi-contrast magnetic resonance images are separated and are fused with a cross-self-attention mechanism to assist reconstruction of under-sampled magnetic resonance images. The residual information in frequency domain separation from the RCSTB reconstructed images was used to complete the final reconstruction. Experimental results show that our method outperforms state-of-art in Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index Measure (SSIM), and Relative L2 Norm Error (RLNE) under different sampling patterns. The reconstruction of details has achieved visible improvements to the naked eye.

computer science, information systems,telecommunications,engineering, electrical & electronic
Multi-Contrast Super-Resolution MRI Through a Progressive Network

Qing Lyu,Hongming Shan,Ge Wang

DOI: https://doi.org/10.1109/TMI.2020.2974858

2019-08-06

Abstract:Magnetic resonance imaging (MRI) is widely used for screening, diagnosis, image-guided therapy, and scientific research. A significant advantage of MRI over other imaging modalities such as computed tomography (CT) and nuclear imaging is that it clearly shows soft tissues in multi-contrasts. Compared with other medical image super-resolution (SR) methods that are in a single contrast, multi-contrast super-resolution studies can synergize multiple contrast images to achieve better super-resolution results. In this paper, we propose a one-level non-progressive neural network for low up-sampling multi-contrast super-resolution and a two-level progressive network for high up-sampling multi-contrast super-resolution. Multi-contrast information is combined in high-level feature space. Our experimental results demonstrate that the proposed networks can produce MRI super-resolution images with good image quality and outperform other multi-contrast super-resolution methods in terms of structural similarity and peak signal-to-noise ratio. Also, the progressive network produces a better SR image quality than the non-progressive network, even if the original low-resolution images were highly down-sampled.

Image and Video Processing,Machine Learning,Medical Physics
Multi-Source Deep Residual Fusion Network for Depth Image Super-resolution

Xiaohui Hao,Tao Lu,Yanduo Zhang,Zhongyuan Wang,Hui Chen

DOI: https://doi.org/10.1145/3366715.3366731

2019-01-01

Abstract:Comparing with color images, depth images are often in lack of texture information in high quality. Depth image super-resolution provides an efficient solution to enhance the high frequency information of LR depth image. In this paper, we propose a novel multi-source residual fusion neural network named "MSRFN", which fully uses the fruitful texture information of color images to guide the depth images reconstruction. Initially, color and depth images are used to extract residual features in two-branch network. Then, color residual and depth residual are fused by the fusion network. Finally, the high-resolution (HR) depth map is reconstructed by fusing multi-source high-frequency information. Experimental results on MPI Sintel and Middlebury public databases show that MSRFN outperforms some state-of-the-art approaches in subjective and objective measures.
Flexible Alignment Super-Resolution Network for Multi-Contrast Magnetic Resonance Imaging

Yiming Liu,Mengxi Zhang,Bo Jiang,Bo Hou,Dan Liu,Jie Chen,Heqing Lian

DOI: https://doi.org/10.1109/tmm.2023.3330085

IF: 7.3

2024-01-01

IEEE Transactions on Multimedia

Abstract:Super-resolution is essential in improving the image quality of Magnetic Resonance Imaging (MRI). Existing MRI Super-Resolution methods leverage multi-contrast MRI and achieve satisfied effects. However, these methods perform alignment by calculating the similarity of single-scale semantic features between reference images and low-resolution images, which causes misalignment and limits the performance of MRI Super-Resolution. To tackle this problem, we propose the Flexible Alignment Super-resolution Network (FASR-Net) for multi-contrast MRI Super-resolution, which explores the interaction of multi-scale features. To this end, we first use the feature extractor to generate multi-scale features, including hierarchical features and semantic pyramid features. Subsequently, we introduce the Hierarchical-Feature Alignment (HF) module and the Semantic-Pyramid-Feature Alignment (SF) module to align hierarchical features and semantic pyramid features, respectively. Finally, the Cross-Hierarchical Progressive Fusion (CHPF) module fuses these aligned features at different scales, which further improves the model's performance. Extensive experiments on FastMRI and IXI datasets show that FASR-net achieves the most competitive results over state-of-the-art approaches. Our code will be available at FASR-Net .
Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

Yanpeng Cao,Fan Wang,Zewei He,Jiangxin Yang,Yanlong Cao

DOI: https://doi.org/10.1109/jsen.2021.3139452

IF: 4.3

2021-01-01

IEEE Sensors Journal

Abstract:Image Super-Resolution (SR) provides a promising technique to enhance the image quality of low-resolution sensors for a wide range of optical applications. It is noted that the costs for capturing high-resolution images in various spectral ranges are significantly different, thus it is reasonable to utilize low-cost channel images (e.g., visible/depth images) as guidance to boost the accuracy of SR results of the expensive channel (e.g., thermal images) significantly. In this paper, we attempt to leverage complementary information from low-cost channels (visible/depth) to boost image quality of an expensive channel (thermal) using fewer parameters. To this end, we first build a multi-modal imaging system and present an effective method to generate pixel-wise aligned visible and thermal images via virtual 3D viewpoint rendering. Then, we design a feature-level multispectral fusion residual network model to perform high-accuracy SR of thermal images by adaptively integrating co-occurrence features presented in multispectral images. Experimental results demonstrate that this novel approach can effectively alleviate the ill-posed inverse problem of image SR by taking into account complementary information from an additional low-cost channel, significantly outperforming state-of-the-art SR approaches in terms of both accuracy and efficiency.
Multi-level feature extraction and reconstruction for 3D MRI image super-resolution

Hongbi Li,Yuanyuan Jia,Huazheng Zhu,Baoru Han,Jinglong Du,Yanbing Liu

DOI: https://doi.org/10.1016/j.compbiomed.2024.108151

IF: 7.7

2024-02-23

Computers in Biology and Medicine

Abstract:Magnetic resonance imaging (MRI) is an essential radiology technique in clinical diagnosis, but its spatial resolution may not suffice to meet the growing need for precise diagnosis due to hardware limitations and thicker slice thickness. Therefore, it is crucial to explore suitable methods to increase the resolution of MRI images. Recently, deep learning has yielded many impressive results in MRI image super-resolution (SR) reconstruction. However, current SR networks mainly use convolutions to extract relatively single image features, which may not be optimal for further enhancing the quality of image reconstruction. In this work, we propose a multi-level feature extraction and reconstruction (MFER) method to restore the degraded high-resolution details of MRI images. Specifically, to comprehensively extract different types of features, we design the triple-mixed convolution by leveraging the strengths and uniqueness of different filter operations. For the features of each level, we then apply deconvolutions to upsample them separately at the tail of the network, followed by the feature calibration of spatial and channel attention. Besides, we also use a soft cross-scale residual operation to improve the effectiveness of parameter optimization. Experiments on lesion-free and glioma datasets indicate that our method obtains superior quantitative performance and visual effects when compared with state-of-the-art MRI image SR methods.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology

A miniaturized membrane inlet mass spectrometry interface for analysis of nitric oxide in human plasma.

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

DuDoINet: Dual-Domain Implicit Network for Multi-Modality MR Image Arbitrary-scale Super-Resolution

Lightweight Multi-Attention Fusion Network for Image Super-Resolution

Multicontrast MRI Super-Resolution Via Transformer-Empowered Multiscale Contextual Matching and Aggregation.

Multi-contrast High Quality MR Image Super-Resolution with Dual Domain Knowledge Fusion

Compound Attention and Neighbor Matching Network for Multi-contrast MRI Super-resolution

Cross-contrast mutual fusion network for joint MRI reconstruction and super-resolution

Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution

Dual Arbitrary Scale Super-Resolution for Multi-Contrast MRI

SGSR: Structure-Guided Multi-Contrast MRI Super-Resolution via Spatio-Frequency Co-Query Attention

MAPANet: A Multi-Scale Attention-Guided Progressive Aggregation Network for Multi-Contrast MRI Super-Resolution

Edge-guided and Cross-scale Feature Fusion Network for Efficient Multi-contrast MRI Super-Resolution

Dual-Domain Multi-Contrast MRI Reconstruction with Synthesis-based Fusion Network

Multi-Contrast MRI Reconstruction Based on Frequency Domain Separation and Cross-Self-Attention

Multi-Contrast Super-Resolution MRI Through a Progressive Network

Multi-Source Deep Residual Fusion Network for Depth Image Super-resolution

Flexible Alignment Super-Resolution Network for Multi-Contrast Magnetic Resonance Imaging

Boosting Image Super-Resolution Via Fusion of Complementary Information Captured by Multi-Modal Sensors

Multi-level feature extraction and reconstruction for 3D MRI image super-resolution