Abstract:Background: Recently, magnetic resonance imaging (MRI) has become a crucial medical imaging technology widely used in clinical practice. However, MRI faces challenges such as the lengthy acquisition time for k-space data and the need for time-consuming manual annotation by radiologists. Traditionally, these challenges have been addressed individually through undersampled MRI reconstruction and automatic segmentation algorithms. Whether undersampled MRI segmentation can be enhanced by treating undersampled MRI reconstruction and segmentation as an end-to-end task, trained simultaneously, rather than as serial tasks should be explored. Purpose: We introduce a novel Transformer- and Joint Learning-based Dual-domain Network (TJLD-Net) for undersampled MRI segmentation. Methods: This method significantly enhances feature recognition in the segmentation process by fully utilizing the rich detail obtained during the image reconstruction phase. Consequently, the method can achieve precise and reliable image segmentation even with undersampled k-space data. Additionally, it incorporates an attention mechanism for feature enhancement, which improves the representation of shared features by learning the contextual information in MR images. Results: Simulation experiments demonstrate that the segmentation performance of TJLD-Net on three datasets is significantly higher than that of the joint model (RecSeg) and six baseline models (where reconstruction and segmentation are regarded as serial tasks). On the CHAOS dataset, the Dice scores of TJLD-Net are, on average, 9.87%, 2.17%, 1.90%, 1.80%, 9.60%, 0.80%, and 6.50% higher than those of the seven compared models. On the ATLAS challenge dataset, the average Dice scores of TJLD-Net improve by 4.23%, 5.63%, 2.30%, 1.53%, 3.57%, 0.93%, and 6.60%. Similarly, on the SKM-TEA dataset, the average Dice scores of TJLD-Net improve by 4.73%, 12.80%, 14.83%, 8.67%, 4.53%, 11.60%, and 12.10%. The novel TJLD-Net model provides a promising solution for undersampled MRI segmentation, overcoming the poor performance issues encountered by automated segmentation algorithms in low-quality accelerated imaging.

Task Transformer Network for Joint MRI Reconstruction and Super-Resolution

Rethinking Multi-Contrast MRI Super-Resolution: Rectangle-Window Cross-Attention Transformer and Arbitrary-Scale Upsampling

Cross-contrast mutual fusion network for joint MRI reconstruction and super-resolution

Hybrid Feature Fusion Neural Network Integrating Transformer for DCE-MRI Super Resolution

Brain MRI Super-Resolution Using Coupled-Projection Residual Network

Enhancing CT Image synthesis from multi-modal MRI data based on a multi-task neural network framework

Multi-level Temporal Information Sharing Transformer-Based Feature Reuse Network for Cardiac MRI Reconstruction.

Coupled-Projection Residual Network for MRI Super-Resolution

Iterative Temporal-Spatial Transformer-based Cardiac T1 Mapping MRI Reconstruction

Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution

3D-MRI super-resolution reconstruction using multi-modality based on multi-resolution CNN

Adjacent Slices Feature Transformer Network for Single Anisotropic 3D Brain MRI Image Super-Resolution

DCT-net: Dual-domain cross-fusion transformer network for MRI reconstruction

Joint Image Reconstruction and Super-Resolution for Accelerated Magnetic Resonance Imaging

Transformer- and joint learning-based dual-domain networks for undersampled MRI segmentation

3D Cross-Scale Feature Transformer Network for Brain Mr Image Super-Resolution

Multi-Contrast MRI Super-Resolution Via a Multi-Stage Integration Network.

Simultaneous Deep Learning of Myocardium Segmentation and T2 Quantification for Acute Myocardial Infarction MRI

TRANS-Net: Transformer-Enhanced Residual-Error AlterNative Suppression Network for MRI Reconstruction.

Deep Learning Based MRI Reconstruction with Transformer

Cross-Modality High-Frequency Transformer for MR Image Super-Resolution