A Hierarchical Full-Resolution Fusion Network and Topology-aware Connectivity Booster for Retinal Vessel Segmentation

Hexing Su,Le Gao,Zhimin Wang,Yong Yu,Jin Hong,Yongqiao Gao
DOI: https://doi.org/10.1109/tim.2024.3411133
IF: 5.6
2024-01-01
IEEE Transactions on Instrumentation and Measurement
Abstract:Segmentation of blood vessels in retinal fundus images is crucial for detecting and diagnosing eye diseases. In recent years, the application of deep learning methods based on convolutional neural networks (CNNs) in retinal blood vessel segmentation has made significant progress in performance. However, the downsampling operation used by CNN to extract high-level contextual semantics will cause the loss of low-level blood vessel spatial details. Therefore, accurately segmenting retinal blood vessels remains challenging. In this article, we propose a hierarchical full-resolution fusion network (HFRF-Net) for accurate blood vessel segmentation from retinal fundus images. In HFRF-Net, we design spatial path and contextual path based on a hierarchical structure, which is used to extract rich spatial features and sufficient contextual semantics, respectively. In the contextual path, we propose a cross-scale attention (CSA) block to simulate the interaction at multiple scales in the vascular region. Then, to cope with the loss of spatial information, we propose a full-resolution learning strategy, which consists of a spatial detail enhancement (SDE) block and a full-resolution fusion (FRF) block. The SDE block performs fine-grained analysis and feature extraction of blood vessels by multiplexing the original fundus images in the spatial path. Meanwhile, the FRF block is proposed to guide the full-resolution information fusion of contextual path and spatial path, which preserves the microstructure of blood vessels to the greatest extent. In addition to the design of the network architecture, we also propose a topology-aware connectivity booster (TCB) to improve the connectivity of blood vessels in the segmentation map. We conducted extensive experiments on three mainstream retinal fundus image datasets (DRIVE, CHASE-DB1, and STARE). Compared to other state-of-the-art methods, the results demonstrate that our method achieves superior segmentation performance.
What problem does this paper attempt to address?