Abstract:Cardiovascular disease remains a predominant global health concern, responsible for a significant portion of mortality worldwide. Accurate segmentation of cardiac medical imaging data is pivotal in mitigating fatality rates associated with cardiovascular conditions. However, existing state-of-the-art (SOTA) neural networks, including both CNN-based and Transformer-based approaches, exhibit limitations in practical applicability due to their inability to effectively capture inter-slice connections alongside intra-slice information. This deficiency is particularly evident in datasets featuring intricate, long-range details along the z-axis, such as coronary arteries in axial views. Additionally, SOTA methods fail to differentiate non-cardiac components from myocardium in segmentation, leading to the "spraying" phenomenon. To address these challenges, we present RotCAtt-TransUNet++, a novel architecture tailored for robust segmentation of complex cardiac structures. Our approach emphasizes modeling global contexts by aggregating multiscale features with nested skip connections in the encoder. It integrates transformer layers to capture interactions between patches and employs a rotatory attention mechanism to capture connectivity between multiple slices (inter-slice information). Additionally, a channel-wise cross-attention gate guides the fused multi-scale channel-wise information and features from decoder stages to bridge semantic gaps. Experimental results demonstrate that our proposed model outperforms existing SOTA approaches across four cardiac datasets and one abdominal dataset. Importantly, coronary arteries and myocardium are annotated with near-perfect accuracy during inference. An ablation study shows that the rotatory attention mechanism effectively transforms embedded vectorized patches in the semantic dimensional space, enhancing segmentation accuracy.

CardiacSeg: Customized Pre-training Volumetric Transformer with Scaling Pyramid for 3D Cardiac Segmentation.

Segmentation of Cardiac Tissues and Organs for CCTA Images Based on a Deep Learning Model

DeU-Net: Deformable U-Net for 3D Cardiac MRI Video Segmentation

TF-Unet:An Automatic Cardiac MRI Image Segmentation Method

Cardiac MRI Segmentation with Focal Loss Constrained Deep Residual Networks

Transforming Heart Chamber Imaging: Self-Supervised Learning for Whole Heart Reconstruction and Segmentation

CardiacSegFormer: Transformer for Semantic Segmentation of Cardiac Images.

Enhancing Cardiac MRI Segmentation via Classifier-Guided Two-Stage Network and All-Slice Information Fusion Transformer

Few-Shot Learning by a Cascaded Framework with Shape-Constrained Pseudo Label Assessment for Whole Heart Segmentation.

Pseudo-3D Network for Multi-sequence Cardiac MR Segmentation

CardSegNet: An adaptive hybrid CNN-vision transformer model for heart region segmentation in cardiac MRI

3D Consistent & Robust Segmentation of Cardiac Images by Deep Learning with Spatial Propagation

Residual Convolutional Neural Network for Cardiac Image Segmentation and Heart Disease Diagnosis.

Graph matching and deep neural networks based whole heart and great vessel segmentation in congenital heart disease

MSMHSA-DeepLab V3+: An Effective Multi-Scale, Multi-Head Self-Attention Network for Dual-Modality Cardiac Medical Image Segmentation

Dual-Branch TransV-Net for 3D Echocardiography Segmentation

RotCAtt-TransUNet++: Novel Deep Neural Network for Sophisticated Cardiac Segmentation

A cascaded framework with cross-modality transfer learning for whole heart segmentation

Consistency Based Co-segmentation for Multi-view Cardiac MRI Using Vision Transformer

An improved contrastive learning network for semi-supervised multi-structure segmentation in echocardiography

A Fully Convolutional Neural Network for Cardiac Segmentation in Short-Axis MRI