Abstract:Background and objective: Despite the considerable progress achieved by U-Net-based models, medical image segmentation remains a challenging task due to complex backgrounds, irrelevant noises, and ambiguous boundaries. In this study, we present a novel approach called U-shaped Graph-and Transformer-guided Boundary Aware Network (GTBA-Net) to tackle these challenges.Methods: GTBA-Net uses the pre-trained ResNet34 as its basic structure, and involves Global Feature Aggregation (GFA) modules for target localization, Graph-based Dynamic Feature Fusion (GDFF) modules for effective noise suppression, and Uncertainty-based Boundary Refinement (UBR) modules for accurate delineation of ambiguous boundaries. The GFA modules employ an efficient self-attention mechanism to facilitate coarse target localization amidst complex backgrounds, without introducing additional computational complexity. The GDFF modules leverage graph attention mechanism to aggregate information hidden among high-and low-level features, effectively suppressing target-irrelevant noises while preserving valuable spatial details. The UBR modules introduce an uncertainty quantification strategy and auxiliary loss to guide the model's focus towards target regions and uncertain "ridges", gradually mitigating boundary uncertainty and ultimately achieving accurate boundary delineation.Results: Comparative experiments on five datasets encompassing diverse modalities (including X-ray, CT, endoscopic procedures, and ultrasound) demonstrate that the proposed GTBA-Net outperforms existing methods in various challenging scenarios. Subsequent ablation studies further demonstrate the efficacy of the GFA, GDFF, and UBR modules in target localization, noise suppression, and ambiguous boundary delineation, respectively.Conclusions: GTBA-Net exhibits substantial potential for extensive application in the field of medical image segmentation, particularly in scenarios involving complex backgrounds, target-irrelevant noises, or ambiguous boundaries.

Uncertainty-Based Dynamic Graph Neighborhoods for Medical Segmentation

Uncertainty-based graph convolutional networks for organ segmentation refinement

Graph- and transformer-guided boundary aware network for medical image segmentation

Graph-BAS3Net: Boundary-Aware Semi-Supervised Segmentation Network with Bilateral Graph Convolution

CGRNet: Contour-guided graph reasoning network for ambiguous biomedical image segmentation

Improving Anatomical Plausibility in Medical Image Segmentation via Hybrid Graph Neural Networks: Applications to Chest X-Ray Analysis

Graph based multi-scale neighboring topology deep learning for kidney and tumor segmentation

UC-Hybrid: Uncertainty-based contrastive learning on hybrid network for medical image segmentation

Uncertainty and Prediction Quality Estimation for Semantic Segmentation via Graph Neural Networks

Hierarchical Uncertainty Estimation for Medical Image Segmentation Networks

Spatial Correspondence between Graph Neural Network-Segmented Images

Uncertainty-aware Hierarchical Aggregation Network for Medical Image Segmentation

Dimensionality Reduction and Nearest Neighbors for Improving Out-of-Distribution Detection in Medical Image Segmentation

Uncertainty-guided dual-views for semi-supervised volumetric medical image segmentation

3D PET/CT tumor segmentation based on nnU-Net with GCN refinement

ADNet++: A few-shot learning framework for multi-class medical image volume segmentation with uncertainty-guided feature refinement

3D PETCT Tumor Lesion Segmentation via GCN Refinement

Towards Generalizable Medical Image Segmentation with Pixel-wise Uncertainty Estimation

Calibrated Uncertainty-Guided Multi-task Framework for Medical Image Segmentation.

A Novel Quality Control Algorithm for Medical Image Segmentation Based on Fuzzy Uncertainty

Finding novelty with uncertainty