Classification, Regression and Segmentation directly from k-Space in Cardiac MRI

Ruochen Li,Jiazhen Pan,Youxiang Zhu,Juncheng Ni,Daniel Rueckert

2024-07-29

Abstract:Cardiac Magnetic Resonance Imaging (CMR) is the gold standard for diagnosing cardiovascular diseases. Clinical diagnoses predominantly rely on magnitude-only Digital Imaging and Communications in Medicine (DICOM) images, omitting crucial phase information that might provide additional diagnostic benefits. In contrast, k-space is complex-valued and encompasses both magnitude and phase information, while humans cannot directly perceive. In this work, we propose KMAE, a Transformer-based model specifically designed to process k-space data directly, eliminating conventional intermediary conversion steps to the image domain. KMAE can handle critical cardiac disease classification, relevant phenotype regression, and cardiac morphology segmentation tasks. We utilize this model to investigate the potential of k-space-based diagnosis in cardiac MRI. Notably, this model achieves competitive classification and regression performance compared to image-domain methods e.g. Masked Autoencoders (MAEs) and delivers satisfactory segmentation performance with a myocardium dice score of 0.884. Last but not least, our model exhibits robust performance with consistent results even when the k-space is 8* undersampled. We encourage the MR community to explore the untapped potential of k-space and pursue end-to-end, automated diagnosis with reduced human intervention.

Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper aims to address several key issues in the diagnosis of cardiovascular diseases, particularly in the use of Cardiac Magnetic Resonance Imaging (CMR) data. Specifically, the research objectives can be summarized as follows: 1. **Diagnosis directly from k-space**: Traditional CMR diagnosis mainly relies on Digital Imaging and Communications in Medicine (DICOM) images that only contain magnitude information, ignoring potentially valuable phase information. This paper proposes a new method that can directly process complex-valued k-space data containing both magnitude and phase information. 2. **Avoid intermediate conversion steps**: The proposed method (KMAE model) can directly handle k-space data without converting it to the image domain, thereby avoiding the intermediate conversion steps common in traditional methods. 3. **Perform multiple downstream tasks**: The model is not limited to image reconstruction but can also be used for cardiac disease classification, related phenotype regression, and cardiac morphology segmentation, among other downstream tasks. 4. **Handle undersampled data**: In accelerated MRI scans, k-space data is often undersampled, which can lead to degraded image quality and affect subsequent analysis. The model can maintain stable and high-quality performance even in the case of undersampled k-space data. 5. **Improve diagnostic efficiency**: By diagnosing directly from k-space data, the need for human intervention is reduced, and an end-to-end automated diagnostic process is expected to be achieved. In summary, the main goal of this paper is to demonstrate how a new model based on the Transformer architecture (KMAE) can directly perform tasks such as cardiac disease classification, phenotype regression, and cardiac segmentation from k-space data, and to validate the effectiveness and robustness of this approach, especially when dealing with undersampled data. Additionally, the study emphasizes the importance of exploring the untapped potential of k-space and encourages the medical imaging community to further investigate this direction.

Classification, Regression and Segmentation directly from k-Space in Cardiac MRI

Reliable Off-Resonance Correction in High-Field Cardiac MRI Using Autonomous Cardiac B0 Segmentation with Dual-Modality Deep Neural Networks.

Exploiting K-Space in Magnetic Resonance Imaging Diagnosis: Dual-Path Attention Fusion for K-Space Global and Image Local Features

CMRxRecon2024: A Multi-Modality, Multi-View K-Space Dataset Boosting Universal Machine Learning for Accelerated Cardiac MRI

A Multi-Task Network For Cardiac Magnetic Resonance Image Segmentation And Classification

Joint Motion Estimation and Segmentation from Undersampled Cardiac MR Image

Neural Implicit k-Space for Binning-free Non-Cartesian Cardiac MR Imaging

Direct Cardiac Segmentation from Undersampled K-space Using Transformers

Enhancing Cardiac MRI Segmentation via Classifier-Guided Two-Stage Network and All-Slice Information Fusion Transformer

Automatic Cardiac Disease Assessment on cine-MRI via Time-Series Segmentation and Domain Specific Features

Fully Automatic Segmentation of Short-Axis Cardiac MRI Using Modified Deep Layer Aggregation.

CMRxRecon: A publicly available k -space dataset and benchmark to advance deep learning for cardiac MRI

Automated T1 and T2 mapping segmentation on cardiovascular magnetic resonance imaging using deep learning

Automatic Segmentation of Different Pathologies from Cardiac Cine MRI Using Registration and Multiple Component EM Estimation

Feature Tracking Cardiac Magnetic Resonance via Deep Learning and Spline Optimization

Automatic Cardiac MRI Segmentation and Permutation-Invariant Pathology Classification Using Deep Neural Networks and Point Clouds.

Myocardial Segmentation of Cardiac MRI Sequences With Temporal Consistency for Coronary Artery Disease Diagnosis

Multi-component Deformable Models Coupled with 2D-3D U-Net for Automated Probabilistic Segmentation of Cardiac Walls and Blood

Fully Automatic initialization and segmentation of left and right ventricles for large-scale cardiac MRI using a deeply supervised network and 3D-ASM

Deep neural network ensemble for on-the-fly quality control-driven segmentation of cardiac MRI T1 mapping

Automatic diagnosis of cardiac magnetic resonance images based on semi-supervised learning