Abstract:Background: Recently, magnetic resonance imaging (MRI) has become a crucial medical imaging technology widely used in clinical practice. However, MRI faces challenges such as the lengthy acquisition time for k-space data and the need for time-consuming manual annotation by radiologists. Traditionally, these challenges have been addressed individually through undersampled MRI reconstruction and automatic segmentation algorithms. Whether undersampled MRI segmentation can be enhanced by treating undersampled MRI reconstruction and segmentation as an end-to-end task, trained simultaneously, rather than as serial tasks should be explored. Purpose: We introduce a novel Transformer- and Joint Learning-based Dual-domain Network (TJLD-Net) for undersampled MRI segmentation. Methods: This method significantly enhances feature recognition in the segmentation process by fully utilizing the rich detail obtained during the image reconstruction phase. Consequently, the method can achieve precise and reliable image segmentation even with undersampled k-space data. Additionally, it incorporates an attention mechanism for feature enhancement, which improves the representation of shared features by learning the contextual information in MR images. Results: Simulation experiments demonstrate that the segmentation performance of TJLD-Net on three datasets is significantly higher than that of the joint model (RecSeg) and six baseline models (where reconstruction and segmentation are regarded as serial tasks). On the CHAOS dataset, the Dice scores of TJLD-Net are, on average, 9.87%, 2.17%, 1.90%, 1.80%, 9.60%, 0.80%, and 6.50% higher than those of the seven compared models. On the ATLAS challenge dataset, the average Dice scores of TJLD-Net improve by 4.23%, 5.63%, 2.30%, 1.53%, 3.57%, 0.93%, and 6.60%. Similarly, on the SKM-TEA dataset, the average Dice scores of TJLD-Net improve by 4.73%, 12.80%, 14.83%, 8.67%, 4.53%, 11.60%, and 12.10%. The novel TJLD-Net model provides a promising solution for undersampled MRI segmentation, overcoming the poor performance issues encountered by automated segmentation algorithms in low-quality accelerated imaging.

FR-Net: Joint Reconstruction and Segmentation in Compressed Sensing Cardiac MRI

Deep Learning for Under-Sampled Non-Cartesian ASL MRI Reconstruction

DeU-Net: Deformable U-Net for 3D Cardiac MRI Video Segmentation

DeU-Net 2.0: Enhanced deformable U-Net for 3D cardiac cine MRI segmentation

FR-NET: Focal Loss Constrained Deep Residual Networks for Segmentation of Cardiac MRI.

Cardiac MRI Segmentation with Focal Loss Constrained Deep Residual Networks

Joint reconstruction framework of compressed sensing and nonlinear parallel imaging for dynamic cardiac magnetic resonance imaging

Joint Motion Estimation and Segmentation from Undersampled Cardiac MR Image

Joint Calibrationless Reconstruction and Segmentation of Parallel MRI

Image Reconstruction for Accelerated MR Scan With Faster Fourier Convolutional Neural Networks

Cooperative-Net: An End-to-End Multi-Task Interaction Network for Unified Reconstruction and Segmentation of MR Image

Simultaneous Deep Learning of Myocardium Segmentation and T2 Quantification for Acute Myocardial Infarction MRI

ADMM-Net: A Deep Learning Approach for Compressive Sensing MRI

Deep Network Cascade for Dynamic Cardiac MRI Reconstruction With Motion Feature Incorporation and the Fourier Neural Attention

Joint reconstruction and segmentation in undersampled 3D knee MRI combining shape knowledge and deep learning

DCT-net: Dual-domain cross-fusion transformer network for MRI reconstruction

Joint Image Reconstruction and Super-Resolution for Accelerated Magnetic Resonance Imaging

Reference-Driven Compressed Sensing MR Image Reconstruction Using Deep Convolutional Neural Networks without Pre-Training

Joint segmentation and discontinuity-preserving deformable registration: Application to cardiac cine-MR images

Joint image reconstruction and segmentation of real-time cardiac MRI in free-breathing using a model based on disentangled representation learning

Transformer- and joint learning-based dual-domain networks for undersampled MRI segmentation