Abstract:Morphological and functional changes in retinal vessels are indicators of a variety of chronic diseases, such as diabetes, stroke, and hypertension. However, without a large number of high-quality annotations, existing deep learning-based medical image segmentation approaches may degrade their performance dramatically on the retinal vessel segmentation task. To reduce the demand of high-quality annotations and make full use of massive unlabeled data, we propose a self-supervised multi-task strategy to extract curvilinear vessel features for the retinal vessel segmentation task. Specifically, we use a dense network to extract more vessel features across different layers/slices, which is elaborately designed for hardware to train and test efficiently. Then, we combine three general pre-training tasks (i.e., intensity transformation, random pixel filling, in-painting and out-painting) in an aggregated way to learn rich hierarchical representations of curvilinear retinal vessel structures. Furthermore, a vector classification task module is introduced as another pre-training task to obtain more spatial features. Finally, to make the segmentation network pay more attention to curvilinear structures, a novel dynamic loss is proposed to learn robust vessel details from unlabeled fundus images. These four pre-training tasks greatly reduce the reliance on labeled data. Moreover, our network can learn the retinal vessel features effectively in the pre-training process, which leads to better performance in the target multi-modal segmentation task. Experimental results show that our method provides a promising direction for the retinal vessel segmentation task. Compared with other state-of-the-art supervised deep learning-based methods applied, our method requires less labeled data and achieves comparable segmentation accuracy. For instance, we match the accuracy of the traditional supervised learning methods on DRIVE and Vampire datasets without needing any labeled ground truth image. With elaborately training, we gain the 0.96 accuracy on DRIVE dataset.

Scale-specific auxiliary multi-task contrastive learning for deep liver vessel segmentation

VesselNet: A deep convolutional neural network with multi pathways for robust hepatic vessel segmentation

Enhancing the automatic segmentation and analysis of 3D liver vasculature models

Improving vessel segmentation with multi-task learning and auxiliary data available only during model training

Attention-Guided Deep Neural Network with Multi-Scale Feature Fusion for Liver Vessel Segmentation

Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation

3D Vessel Segmentation with Limited Guidance of 2D Structure-agnostic Vessel Annotations

Laplacian salience-gated feature pyramid network for accurate liver vessel segmentation

A Multi-Task Dense Network with Self-Supervised Learning for Retinal Vessel Segmentation

HPM-Net: Hierarchical progressive multiscale network for liver vessel segmentation in CT images

Vessel Segmentation in Fundus Images with Multi-Scale Feature Extraction and Disentangled Representation

TopNet: Topology Preserving Metric Learning for Vessel Tree Reconstruction and Labelling

Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention

Dual-path multi-scale context dense aggregation network for retinal vessel segmentation

Automated Multiscale 3D Feature Learning for Vessels Segmentation in Thorax CT Images

Learning multi-scale deep fusion for retinal blood vessel extraction in fundus images

Deep vessel segmentation based on a new combination of vesselness filters

Deep vessel segmentation with joint multi-prior encoding

The joint learning of multi-resolution feature for multi-class retinal vessel segmentation

DV-Net: Accurate liver vessel segmentation via dense connection model with D-BCE loss function

Cascaded multitask U-Net using topological loss for vessel segmentation and centerline extraction