Abstract:The accurate segmentation of retinal vessels images can not only be used to evaluate and monitor various ophthalmic diseases, but also timely reflect systemic diseases such as diabetes and blood diseases. Therefore, the study on segmentation of retinal vessels images is of great significance for the diagnosis of visually threatening diseases. In recent years, especially the convolutional neural networks (CNN) based on UNet and its variant have been widely used in various medical image tasks. However, although CNN has achieved excellent performance, it cannot learn global and long-distance semantic information interaction well due to the local computing characteristics of convolution operation, which limits the development of medical image segmentation tasks. Transformer, currently popular in computer vision, has global computing features, but due to the lack of low-level details, local feature information extraction is insufficient. In this paper, we propose Patches Convolution Attention based Transformer UNet (PCAT-UNet), which is a U-shaped network based on Transformer with a Convolution branch. We use skip connection to fuse the deep and shallow features of both sides. By taking advantage of the complementary advantages of both sides, we can effectively capture the global dependence relationship and the details of the underlying feature space, thus improving the current problems of insufficient extraction of retinal micro vessels feature information and low sensitivity caused by easily predicting of pixels as background. In addition, our method enables end-to-end training and rapid inference. Finally, three publicly available retinal vessels datasets (DRIVE, STARE and CHASE_DB1) were used to evaluate PCAT-UNet. The experimental results show that the proposed PCAT-UNET method achieves good retinal vessel segmentation performance on these three datasets, and is superior to other architectures in terms of AUC, Accuracy and Sensitivity performance indicators. AUC reached 0.9872, 0.9953 and 0.9925, Accuracy reached 0.9622, 0.9796 and 0.9812, Sensitivity reached 0.8576, 0.8703 and 0.8493, respectively. In addition, PCAT-UNET also achieved good results in two other F1-Score and Specificity indicators.

C2AM-Unet: Coordinate and Channel Attention Mixing Flexible Architecture for Retinal Vessel Segmentation

A Multi-Scale Residual Attention Network for Retinal Vessel Segmentation

Retinal Vessel Segmentation Via Cross-attention Feature Fusion

Channel Attention Residual U-Net for Retinal Vessel Segmentation

CCS-UNet: a cross-channel spatial attention model for accurate retinal vessel segmentation

A combination of multi‐scale and attention based on the U‐shaped network for retinal vessel segmentation

CMP-UNet: A Retinal Vessel Segmentation Network Based on Multi-Scale Feature Fusion

DCFU‐Net: Rethinking an Effective Attention and Convolutional Architecture for Retinal Vessel Segmentation

CFFANet: category feature fusion and attention mechanism network for retinal vessel segmentation

Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation

Cascaded Attention Guided Network for Retinal Vessel Segmentation.

VascuConNet: an enhanced connectivity network for vascular segmentation

MS-CANet: Multi-Scale Subtraction Network with Coordinate Attention for Retinal Vessel Segmentation

Dual-path multi-scale context dense aggregation network for retinal vessel segmentation

MTPA_Unet: Multi-Scale Transformer-Position Attention Retinal Vessel Segmentation Network Joint Transformer and CNN

Landmark-Assisted Anatomy-Sensitive Retinal Vessel Segmentation Network

RCAR-UNet: Retinal Vessel Segmentation Network Algorithm Via Novel Rough Attention Mechanism

Joint 2D attention gate and channel-spatial attention network for retinal vessel segmentation of OCT-angiography images

An Improved UNet for Retinal Vessel Segmentation Using Semantic Fusion, Attention Mechanism and Multi-Scale Features

PCAT-UNet: UNet-like network fused convolution and transformer for retinal vessel segmentation

Attention Guided U-Net With Atrous Convolution for Accurate Retinal Vessels Segmentation