Abstract:Extracting global and local feature information is still challenging due to the problems of retinal blood vessel medical images like fuzzy edge features, noise, difficulty in distinguishing between lesion regions and background information, and loss of low-level feature information, which leads to insufficient extraction of feature information. To better solve these problems and fully extract the global and local feature information of the image, we propose a novel transscale cascade layered transformer network for enhanced retinal blood vessel segmentation, which consists of an encoder and a decoder and is connected between the encoder and decoder by a transscale transformer cascade module. Among them, the encoder consists of a local-global transscale transformer module, a multi-head layered transscale adaptive embedding module, and a local context(LCNet) module. The transscale transformer cascade module learns local and global feature information from the first three layers of the encoder, and multi-scale dependent features, fuses the hierarchical feature information from the skip connection block and the channel-token interaction fusion block, respectively, and inputs it to the decoder. The decoder includes a decoding module for the local context network and a transscale position transformer module to input the local and global feature information extracted from the encoder with retained key position information into the decoding module and the position embedding transformer module for recovery and output of the prediction results that are consistent with the input feature information. In addition, we propose an improved cross-entropy loss function based on the difference between the deterministic observation samples and the prediction results with the deviation distance, which is validated on the DRIVE and STARE datasets combined with the proposed network model based on the dual transformer structure in this paper, and the segmentation accuracies are 97.26% and 97.87%, respectively. Compared with other state-of-the-art networks, the results show that the proposed network model has a significant competitive advantage in improving the segmentation performance of retinal blood vessel images.

Transformer and convolutional based dual branch network for retinal vessel segmentation in OCTA images

Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

TCU-Net: Transformer Embedded in Convolutional U-Shaped Network for Retinal Vessel Segmentation

Retinal Vessel Segmentation Via Cross-attention Feature Fusion

MTPA_Unet: Multi-Scale Transformer-Position Attention Retinal Vessel Segmentation Network Joint Transformer and CNN

An Accurate and Efficient Neural Network for OCTA Vessel Segmentation and a New Dataset

A Transformer-Assisted Cascade Learning Network for Choroidal Vessel Segmentation

Automated Retinal Vascular Topological Information Extraction From OCTA

TranSegNet: Hybrid CNN-Vision Transformers Encoder for Retina Segmentation of Optical Coherence Tomography

Joint 2D attention gate and channel-spatial attention network for retinal vessel segmentation of OCT-angiography images

Global Transformer and Dual Local Attention Network Via Deep-Shallow Hierarchical Feature Fusion for Retinal Vessel Segmentation.

TLTNet: A novel transscale cascade layered transformer network for enhanced retinal blood vessel segmentation

HT-Net: A Hybrid Transformer Network for Fundus Vessel Segmentation

Image Magnification Network for Vessel Segmentation in OCTA Images

DCFU‐Net: Rethinking an Effective Attention and Convolutional Architecture for Retinal Vessel Segmentation

Segmentation of Low-Light Optical Coherence Tomography Angiography Images under the Constraints of Vascular Network Topology

A combination of multi‐scale and attention based on the U‐shaped network for retinal vessel segmentation

MT_Net: A Multi-Scale Framework Using the Transformer Block for Retina Layer Segmentation

Retinal Vessel Segmentation based on Fully Convolutional Networks

PCRTAM-Net: A Novel Pre-Activated Convolution Residual and Triple Attention Mechanism Network for Retinal Vessel Segmentation

Dual-path multi-scale context dense aggregation network for retinal vessel segmentation