Abstract:Delineating 3D blood vessels is essential for clinical diagnosis and treatment, however, is challenging due to complex structure variations and varied imaging conditions. Supervised deep learning has demonstrated its superior capacity in automatic 3D vessel segmentation. However, the reliance on expensive 3D manual annotations and limited capacity for annotation reuse hinder the clinical applications of supervised models. To avoid the repetitive and laborious annotating and make full use of existing vascular annotations, this paper proposes a novel 3D shape-guided local discrimination model for 3D vascular segmentation under limited guidance from public 2D vessel annotations. The primary hypothesis is that 3D vessels are composed of semantically similar voxels and exhibit tree-shaped morphology. Accordingly, the 3D region discrimination loss is firstly proposed to learn the discriminative representation measuring voxel-wise similarities and cluster semantically consistent voxels to form the candidate 3D vascular segmentation in unlabeled images; secondly, based on the similarity of the tree-shaped morphology between 2D and 3D vessels, the Crop-and-Overlap strategy is presented to generate reference masks from 2D structure-agnostic vessel annotations, which are fit for varied vascular structures, and the adversarial loss is introduced to guide the tree-shaped morphology of 3D vessels; thirdly, the temporal consistency loss is proposed to foster the training stability and keep the model updated smoothly. To further enhance the model's robustness and reliability, the orientation-invariant CNN module and Reliability-Refinement algorithm are presented. Experimental results from the public 3D cerebrovascular and 3D arterial tree datasets demonstrate that our model achieves comparable effectiveness against nine supervised models.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is the challenges of 3D vessel segmentation in clinical diagnosis and treatment. Specifically, the author points out that due to complex structural changes and different imaging conditions, manual segmentation of 3D vessels is both time - consuming and labor - intensive. In addition, manual annotation depends on the annotator's experience and human factors, which limits the repeatability and reproducibility of manual segmentation. Although supervised deep - learning methods perform well in automatic 3D vessel segmentation, they rely on a large amount of 3D manually - annotated data, which hinders their clinical application and slows down the speed of model construction. To solve these problems, this paper proposes a new 3D Shape - Guided Local Discriminant model (3D - SLD) for 3D vessel segmentation under the guidance of limited public 2D vessel annotations. ### Main problems 1. **High cost and complexity of 3D vessel manual segmentation**: Manual segmentation of 3D vessels is time - consuming and labor - intensive, and depends on the annotator's experience and human factors, resulting in poor repeatability and reproducibility. 2. **Dependence of supervised deep - learning models on a large amount of 3D manually - annotated data**: This dependence limits the clinical application of the model and increases the time and cost of model construction. 3. **Insufficient ability to reuse existing annotated data**: Existing supervised deep - learning models and related methods lack the ability to reuse existing annotated data, resulting in the need to re - annotate when processing images of new modalities or new structures. ### Solutions To overcome the above problems, this paper proposes the 3D - SLD model, which has the following characteristics: - **Utilizing the morphological prior of 2D vessel annotations**: By reusing existing 2D vessel annotations, the repetitive 3D annotation process is avoided. - **3D region discriminant loss**: Used to learn discriminative representations, measure the semantic similarity between voxels, and cluster semantically consistent voxels to form candidate 3D vessel segmentations. - **Crop - and - Overlap strategy**: Generate reference masks that are suitable for different vessel structures and introduce an adversarial loss to guide the dendritic morphology of 3D vessels. - **Temporal consistency loss**: Maintain the stability of model training and ensure the smooth update of the model. - **Orientation - Invariant Convolution Module (ori - CNN)**: Learn features that are robust to changes in visual orientation and improve the representational ability of 3D vessels. - **Reliability optimization algorithm**: Use high - confidence predictions as pseudo - labels to further optimize the reliability of the model. ### Experimental results The experimental results show that this model achieves results comparable to nine deep - learning supervised models on 3D cerebral vessel and 3D arterial tree datasets, demonstrating its effectiveness and superior annotation reuse ability. ### Summary The 3D - SLD model proposed in this paper effectively solves the key problems in 3D vessel segmentation while avoiding expensive and repetitive 3D vessel annotations and making full use of existing 2D vessel annotations, and has important clinical value.

3D Vessel Segmentation with Limited Guidance of 2D Structure-agnostic Vessel Annotations

Segmentation of Cardiac Tissues and Organs for CCTA Images Based on a Deep Learning Model

VesselNet: A deep convolutional neural network with multi pathways for robust hepatic vessel segmentation

3D Vascular Segmentation Supervised by 2D Annotation of Maximum Intensity Projection

Adaptive Semi-Supervised Segmentation of Brain Vessels with Ambiguous Labels

Global Control for Local SO(3)-Equivariant Scale-Invariant Vessel Segmentation

Deep Learning for 3D Vascular Segmentation in Phase Contrast Tomography

Learning Hybrid Representations for Automatic 3D Vessel Centerline Extraction

VPBSD:Vessel-Pattern-Based Semi-Supervised Distillation for Efficient 3D Microscopic Cerebrovascular Segmentation

Hierarchical Deep Network with Uncertainty-aware Semi-supervised Learning for Vessel Segmentation

Optimized Vessel Segmentation: A Structure-Agnostic Approach with Small Vessel Enhancement and Morphological Correction

A Multi-Task Dense Network with Self-Supervised Learning for Retinal Vessel Segmentation

Cross-Anatomy Transfer Learning via Shape-Aware Adaptive Fine-Tuning for 3D Vessel Segmentation

Enhancing the automatic segmentation and analysis of 3D liver vasculature models

A Novel Method for 3D-Segmentation of Vascular Images

Vessel segmentation from volumetric images: a multi-scale double-pathway network with class-balanced loss at the voxel level

A deep learning model for brain vessel segmentation in 3DRA with arteriovenous malformations

Segmentation of Intravascular Ultrasound by Deep Learning on Partially Labelled Dataset

Vascular Segmentation of Neuroimages Based on a Prior Shape and Local Statistics

Head and Neck Vessel Segmentation with Connective Topology Using Affinity Graph