Abstract:Morphological and functional changes in retinal vessels are indicators of a variety of chronic diseases, such as diabetes, stroke, and hypertension. However, without a large number of high-quality annotations, existing deep learning-based medical image segmentation approaches may degrade their performance dramatically on the retinal vessel segmentation task. To reduce the demand of high-quality annotations and make full use of massive unlabeled data, we propose a self-supervised multi-task strategy to extract curvilinear vessel features for the retinal vessel segmentation task. Specifically, we use a dense network to extract more vessel features across different layers/slices, which is elaborately designed for hardware to train and test efficiently. Then, we combine three general pre-training tasks (i.e., intensity transformation, random pixel filling, in-painting and out-painting) in an aggregated way to learn rich hierarchical representations of curvilinear retinal vessel structures. Furthermore, a vector classification task module is introduced as another pre-training task to obtain more spatial features. Finally, to make the segmentation network pay more attention to curvilinear structures, a novel dynamic loss is proposed to learn robust vessel details from unlabeled fundus images. These four pre-training tasks greatly reduce the reliance on labeled data. Moreover, our network can learn the retinal vessel features effectively in the pre-training process, which leads to better performance in the target multi-modal segmentation task. Experimental results show that our method provides a promising direction for the retinal vessel segmentation task. Compared with other state-of-the-art supervised deep learning-based methods applied, our method requires less labeled data and achieves comparable segmentation accuracy. For instance, we match the accuracy of the traditional supervised learning methods on DRIVE and Vampire datasets without needing any labeled ground truth image. With elaborately training, we gain the 0.96 accuracy on DRIVE dataset.

Joint Extraction of Retinal Vessels and Centerlines Based on Deep Semantics and Multi-Scaled Cross-Task Aggregation

Multi-Scale and Multi-Branch Convolutional Neural Network for Retinal Image Segmentation

Retinal Vessel Segmentation Via Cross-attention Feature Fusion

MSC-Net: Multitask Learning Network for Retinal Vessel Segmentation and Centerline Extraction

U-shaped Retinal Vessel Segmentation Based on Adaptive Aggregation of Feature Information

The joint learning of multi-resolution feature for multi-class retinal vessel segmentation

MIC-Net: Multi-Scale Integrated Context Network for Automatic Retinal Vessel Segmentation in Fundus Image

Skeleton-guided multi-scale dual-coordinate attention aggregation network for retinal blood vessel segmentation

Graph-based convolution feature aggregation for retinal vessel segmentation

Dual-path multi-scale context dense aggregation network for retinal vessel segmentation

Exploiting Cross-Scale Attention Transformer and Progressive Edge Refinement for Retinal Vessel Segmentation

Rethinking the Extraction and Interaction of Multi-Scale Features for Vessel Segmentation

Multi-Scale Retinal Vessel Segmentation Based on Fully Convolutional Neural Network

Multichannel Retinal Blood Vessel Segmentation Based on the Combination of Matched Filter and U-Net Network.

A combination of multi‐scale and attention based on the U‐shaped network for retinal vessel segmentation

Multi-Task Siamese Network for Retinal Artery/Vein Separation Via Deep Convolution along Vessel

Multi-scale Retinal Vessel Segmentation Using Encoder-Decoder Network with Squeeze-and-excitation Connection and Atrous Spatial Pyramid Pooling.

Multiscale Joint Optimization Strategy for Retinal Vascular Segmentation

High-precision retinal blood vessel segmentation based on a multi-stage and dual-channel deep learning network

CMP-UNet: A Retinal Vessel Segmentation Network Based on Multi-Scale Feature Fusion

A Multi-Task Dense Network with Self-Supervised Learning for Retinal Vessel Segmentation