Abstract:The accurate segmentation of retinal vessels images can not only be used to evaluate and monitor various ophthalmic diseases, but also timely reflect systemic diseases such as diabetes and blood diseases. Therefore, the study on segmentation of retinal vessels images is of great significance for the diagnosis of visually threatening diseases. In recent years, especially the convolutional neural networks (CNN) based on UNet and its variant have been widely used in various medical image tasks. However, although CNN has achieved excellent performance, it cannot learn global and long-distance semantic information interaction well due to the local computing characteristics of convolution operation, which limits the development of medical image segmentation tasks. Transformer, currently popular in computer vision, has global computing features, but due to the lack of low-level details, local feature information extraction is insufficient. In this paper, we propose Patches Convolution Attention based Transformer UNet (PCAT-UNet), which is a U-shaped network based on Transformer with a Convolution branch. We use skip connection to fuse the deep and shallow features of both sides. By taking advantage of the complementary advantages of both sides, we can effectively capture the global dependence relationship and the details of the underlying feature space, thus improving the current problems of insufficient extraction of retinal micro vessels feature information and low sensitivity caused by easily predicting of pixels as background. In addition, our method enables end-to-end training and rapid inference. Finally, three publicly available retinal vessels datasets (DRIVE, STARE and CHASE_DB1) were used to evaluate PCAT-UNet. The experimental results show that the proposed PCAT-UNET method achieves good retinal vessel segmentation performance on these three datasets, and is superior to other architectures in terms of AUC, Accuracy and Sensitivity performance indicators. AUC reached 0.9872, 0.9953 and 0.9925, Accuracy reached 0.9622, 0.9796 and 0.9812, Sensitivity reached 0.8576, 0.8703 and 0.8493, respectively. In addition, PCAT-UNET also achieved good results in two other F1-Score and Specificity indicators.

Dense-Atrous U-Net with Salient Computing for Accurate Retina Vessel Segmentation

A Multi-Scale Residual Attention Network for Retinal Vessel Segmentation

Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

Attention Guided U-Net With Atrous Convolution for Accurate Retinal Vessels Segmentation

CCS-UNet: a cross-channel spatial attention model for accurate retinal vessel segmentation

SDDC-Net: A U-shaped deep spiking neural P convolutional network for retinal vessel segmentation

Atrous Residual Convolutional Neural Network Based on U-Net for Retinal Vessel Segmentation.

An improved method for retinal vessel segmentation in U-Net

DCFU‐Net: Rethinking an Effective Attention and Convolutional Architecture for Retinal Vessel Segmentation

Retinal Blood Vessels Segmentation With Improved SE‐UNet Model

DUNet: A deformable network for retinal vessel segmentation

U-shaped Retinal Vessel Segmentation Based on Adaptive Aggregation of Feature Information

Retinal Vessels Segmentation Based on Dilated Multi-Scale Convolutional Neural Network

Channel Attention Residual U-Net for Retinal Vessel Segmentation

DilUnet: A U-net based architecture for blood vessels segmentation

Dual-path multi-scale context dense aggregation network for retinal vessel segmentation

Dense Residual Network for Retinal Vessel Segmentation

Landmark-Assisted Anatomy-Sensitive Retinal Vessel Segmentation Network

PCAT-UNet: UNet-like network fused convolution and transformer for retinal vessel segmentation

Attention residual convolution neural network based on U-net (AttentionResU-Net) for retina vessel segmentation

Deep Dilated Convolutional Nets for the Automatic Segmentation of Retinal Vessels