Studies on proteins of animal ribosomes. XII. Determination of molecular weights of ribosomal proteins by SDS Gel electrophoresis.

H. Welfle

Abstract:

What problem does this paper attempt to address?

Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

Zhun Fan,Jiajie Mo,Benzhang Qiu,Wenji Li,Guijie Zhu,Chong Li,Jianye Hu,Yibiao Rong,Xinjian Chen

DOI: https://doi.org/10.48550/arXiv.1906.12193

2020-09-23

Abstract:Retinal vessel segmentation is a crucial step in diagnosing and screening various diseases, including diabetes, ophthalmologic diseases, and cardiovascular diseases. In this paper, we propose an effective and efficient method for vessel segmentation in color fundus images using encoder-decoder based octave convolution networks. Compared with other convolution networks utilizing standard convolution for feature extraction, the proposed method utilizes octave convolutions and octave transposed convolutions for learning multiple-spatial-frequency features, thus can better capture retinal vasculatures with varying sizes and shapes. To provide the network the capability of learning how to decode multifrequency features, we extend octave convolution and propose a new operation named octave transposed convolution. A novel architecture of convolutional neural network, named as Octave UNet integrating both octave convolutions and octave transposed convolutions is proposed based on the encoder-decoder architecture of UNet, which can generate high resolution vessel segmentation in one single forward feeding without post-processing steps. Comprehensive experimental results demonstrate that the proposed Octave UNet outperforms the baseline UNet achieving better or comparable performance to the state-of-the-art methods with fast processing speed. Specifically, the proposed method achieves 0.9664 / 0.9713 / 0.9759 / 0.9698 accuracy, 0.8374 / 0.8664 / 0.8670 / 0.8076 sensitivity, 0.9790 / 0.9798 / 0.9840 / 0.9831 specificity, 0.8127 / 0.8191 / 0.8313 / 0.7963 F1 score, and 0.9835 / 0.9875 / 0.9905 / 0.9845 Area Under Receiver Operating Characteristic curve, on DRIVE, STARE, CHASE_DB1, and HRF datasets, respectively.

Image and Video Processing,Computer Vision and Pattern Recognition
Fully Automated Tree Topology Estimation and Artery-Vein Classification

Aashis Khanal,Saeid Motevali,Rolando Estrada

DOI: https://doi.org/10.48550/arXiv.2202.02382

2022-08-09

Abstract:We present a fully automatic, graph-based technique for extracting the retinal vascular topology -- that is, how different vessels are connected to each other -- given a single color fundus image. Determining this connectivity is very challenging because vessels cross each other in a 2D image, obscuring their true paths. We quantitatively validated the usefulness of our extraction method by using it to achieve comparable state-of-the-art results in retinal artery-vein classification. Our proposed approach works as follows: We first segment the retinal vessels using our previously developed state-of-the-art segmentation method. Then, we estimate an initial graph from the extracted vessels and assign the most likely blood flow to each edge. We then use a handful of high-level operations (HLOs) to fix errors in the graph. These HLOs include detaching neighboring nodes, shifting the endpoints of an edge, and reversing the estimated blood flow direction for a branch. We use a novel cost function to find the optimal set of HLO operations for a given graph. Finally, we show that our extracted vascular structure is correct by propagating artery/vein labels along the branches. As our experiments show, our topology-based artery-vein labeling achieved state-of-the-art results on three datasets: DRIVE, AV-WIDE, and INSPIRE. We also performed several ablation studies to separately verify the importance of the segmentation and AV labeling steps of our proposed method. These ablation studies further confirmed that our graph extraction pipeline correctly models the underlying vascular anatomy.

Image and Video Processing,Computer Vision and Pattern Recognition
Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation

Gangming Zhao,Kongming Liang,Chengwei Pan,Fandong Zhang,Xianpeng Wu,Xinyang Hu,Yizhou Yu

DOI: https://doi.org/10.1109/tmi.2022.3207093

2023-01-01

Abstract:Vessel segmentation is widely used to help with vascular disease diagnosis. Vessels reconstructed using existing methods are often not sufficiently accurate to meet clinical use standards. This is because 3D vessel structures are highly complicated and exhibit unique characteristics, including sparsity and anisotropy. In this paper, we propose a novel hybrid deep neural network for vessel segmentation. Our network consists of two cascaded subnetworks performing initial and refined segmentation respectively. The second subnetwork further has two tightly coupled components, a traditional CNN-based U-Net and a graph U-Net. Cross-network multi-scale feature fusion is performed between these two U-shaped networks to effectively support high-quality vessel segmentation. The entire cascaded network can be trained from end to end. The graph in the second subnetwork is constructed according to a vessel probability map as well as appearance and semantic similarities in the original CT volume. To tackle the challenges caused by the sparsity and anisotropy of vessels, a higher percentage of graph nodes are distributed in areas that potentially contain vessels while a higher percentage of edges follow the orientation of potential nearby vessels. Extensive experiments demonstrate our deep network achieves state-of-the-art 3D vessel segmentation performance on multiple public and in-house datasets.
Multi-Task Neural Networks with Spatial Activation for Retinal Vessel Segmentation and Artery/Vein Classification

Wenao Ma,Shuang Yu,Kai Ma,Jiexiang Wang,Xinghao Ding,Yefeng Zheng

DOI: https://doi.org/10.48550/arXiv.2007.09337

2020-07-18

Abstract:Retinal artery/vein (A/V) classification plays a critical role in the clinical biomarker study of how various systemic and cardiovascular diseases affect the retinal vessels. Conventional methods of automated A/V classification are generally complicated and heavily depend on the accurate vessel segmentation. In this paper, we propose a multi-task deep neural network with spatial activation mechanism that is able to segment full retinal vessel, artery and vein simultaneously, without the pre-requirement of vessel segmentation. The input module of the network integrates the domain knowledge of widely used retinal preprocessing and vessel enhancement techniques. We specially customize the output block of the network with a spatial activation mechanism, which takes advantage of a relatively easier task of vessel segmentation and exploits it to boost the performance of A/V classification. In addition, deep supervision is introduced to the network to assist the low level layers to extract more semantic information. The proposed network achieves pixel-wise accuracy of 95.70% for vessel segmentation, and A/V classification accuracy of 94.50%, which is the state-of-the-art performance for both tasks on the AV-DRIVE dataset. Furthermore, we have also tested the model performance on INSPIRE-AVR dataset, which achieves a skeletal A/V classification accuracy of 91.6%.

Image and Video Processing,Computer Vision and Pattern Recognition
Fundus vascular image segmentation based on multiple attention mechanisms and deep learning

Pengpeng Luan,Yuanyuan Peng

Abstract:Accurately segmenting blood vessels in retinal fundus images is crucial in the early screening, diagnosing, and evaluating some ocular diseases, yet it poses a nontrivial uncertainty for the segmentation task due to various factors such as significant light variations, uneven curvilinear structures, and non-uniform contrast. As a result, a useful approach based on multiple attention mechanisms and deep learning is proposed to accurately detect blood vessels in retinal fundus images. To enrich contextual information for the loss of scene information compensation, an attention fusion mechanism that combines the channel attention with spatial attention mechanisms constructed by Transformer is employed to extract various features of blood vessels from retinal fundus images in both spatial and channel dimensions. Subsequently, a unique spatial attention mechanism is introduced in the skip connection to filter out redundant information and noise from low-level features, thus enabling better integration with high-level features. In addition, a DropOut layer is employed to randomly discard some neurons, which can prevent overfitting of the deep learning network and improve its generalization performance. Experimental results were verified in public datasets DRIVE, STARE and CHASEDB1 with F 1 scores of 0.818, 0.836 and 0.811, and Acc values of 0.968, 0.973 and 0.973, respectively. Both visual inspection and quantitative evaluation demonstrate that our method produces satisfactory results compared to some state-of-the-art methods.

Computer Science,Medicine
A combination of multi‐scale and attention based on the U‐shaped network for retinal vessel segmentation

Yan Zhang,Qingyan Lan,Yemei Sun,Chunming Ma

DOI: https://doi.org/10.1002/ima.23045

IF: 2.177

2024-02-26

International Journal of Imaging Systems and Technology

Abstract:Abstract Automated partitioning of retinal vessels depicted in fundus images is beneficial in the detection of specific ailments like hypertension and diabetes. However, retinal vessel images have the problems of a large semantic range, more spatial detail, and limited differentiation among the blood vessels and surroundings, which make vessel segmentation challenging. To overcome these obstacles, we designed a new U‐shaped network named SMP‐Net. First, we propose the sequencer‐convolution (SC) module to obtain the ability to extract both local and global features, thereby improving segmentation accuracy. The SC module is used to filter out shallow noise and enable the fusion of deep and shallow features in the maximum skip connection of the U‐shaped network. Then, the residual multi‐kernel pooling (MP) module is designed to obtain additional contextual information while also mitigating the loss of spatial information caused by constant pooling and convolution to improve vessel coherence. Finally, the pixel attention (PA) module redistributes the weight of each pixel using an element‐wise product multiplication operation. This increases the weight of the vascular feature pixels and improves the ability to identify blood vessels in blurred backgrounds. The proposed method has been demonstrated to be effective through sufficient experimentation on publicly available retinal datasets such as DRIVE, STARE, and CHASE_DB1.

engineering, electrical & electronic,optics,imaging science & photographic technology
Multi-scale Interactive Network with Artery/Vein Discriminator for Retinal Vessel Classification

Jingfei Hu,Hua Wang,Guang Wu,Zhaohui Cao,Lei Mou,Yitian Zhao,Jicong Zhang

DOI: https://doi.org/10.1109/jbhi.2022.3165867

IF: 7.7

2022-01-01

IEEE Journal of Biomedical and Health Informatics

Abstract:Automatic classification of retinal arteries and veins plays an important role in assisting clinicians to diagnosis cardiovascular and eye-related diseases. However, due to the high degree of anatomical variation across the population, and the presence of inconsistent labels by the subjective judgment of annotators in available training data, most of existing methods generally suffer from blood vessel discontinuity and arteriovenous confusion, the artery/vein (A/V) classification task still faces great challenges. In this work, we propose a multi-scale interactive network with A/V discriminator for retinal artery and vein recognition, which can reduce the arteriovenous confusion and alleviate the disturbance of noisy label. A multi-scale interaction (MI) module is designed in encoder for realizing the cross-space multi-scale features interaction of fundus images, effectively integrate high-level and low-level context information. In particular, we also design an ingenious A/V discriminator (AVD) that utilizes the independent and shared information between arteries and veins, and combine with topology loss, to further strengthen the learning ability of model to resolve the arteriovenous confusion. In addition, we adopt a sample re-weighting (SW) strategy to effectively alleviate the disturbance from data labeling errors. The proposed model is verified on three publicly available fundus image datasets (AV-DRIVE, HRF, LES-AV) and a private dataset. We achieve the accuracy of 97.47%, 96.91%, 97.79%, and 98.18% respectively on these four datasets. Extensive experimental results demonstrate that our method achieves competitive performance compared with state-of-the-art methods for A/V classification. To address the problem of training data scarcity, we publicly release 100 fundus images with A/V annotations to promote relevant research in the community.

computer science, interdisciplinary applications,mathematical & computational biology,medical informatics, information systems
A high resolution representation network with multi-path scale for retinal vessel segmentation

Zefang Lin,Jianping Huang,Yingyin Chen,Xiao Zhang,Wei Zhao,Yong Li,Ligong Lu,Meixiao Zhan,Xiaofei Jiang,Xiong Liang

DOI: https://doi.org/10.1016/j.cmpb.2021.106206

IF: 6.1

2021-09-01

Computer Methods and Programs in Biomedicine

Abstract:Background and objectives: Automatic retinal vessel segmentation (RVS) in fundus images is expected to be a vital step in the early image diagnosis of ophthalmologic diseases. However, it is a challenging task to detect the retinal vessel accurately mainly due to the vascular intricacies, lesion areas and optic disc edges in retinal fundus images. Methods: In this paper, we propose a high resolution representation network with multi-path scale (MPS-Net) for RVS aiming to improve the performance of extracting the retinal blood vessels. In the MPS-Net, there exist one high resolution main road and two lower resolution branch roads where the proposed multi-path scale modules are embedded to enhance the representation ability of network. Besides, in order to guide the network focus on learning the features of hard examples in retinal images, we design a hard-focused cross-entropy loss function. Results: We evaluate our network structure on DRIVE, STARE, CHASE and synthetic images and the quantitative comparisons with respect to the existing methods are presented. The experimental results show that our approach is superior to most methods in terms of F1-score, sensitivity, G-mean and Matthews correlation coefficient. Conclusions: The promising segmentation performances reveal that our method has potential in real-world applications and can be exploited for other medical images with further analysis.

engineering, biomedical,computer science, interdisciplinary applications,medical informatics, theory & methods
Retinal Vascular Network Topology Reconstruction and Artery/Vein Classification via Dominant Set Clustering

Yitian Zhao,Jianyang Xie,Huaizhong Zhang,Yalin Zheng,Yifan Zhao,Hong Qi,Yangchun Zhao,Pan Su,Jiang Liu,Yonghuai Liu

DOI: https://doi.org/10.1109/tmi.2019.2926492

IF: 10.6

2020-02-01

IEEE Transactions on Medical Imaging

Abstract:The estimation of vascular network topology in complex networks is important in understanding the relationship between vascular changes and a wide spectrum of diseases. Automatic classification of the retinal vascular trees into arteries and veins is of direct assistance to the ophthalmologist in terms of diagnosis and treatment of eye disease. However, it is challenging due to their projective ambiguity and subtle changes in appearance, contrast, and geometry in the imaging process. In this paper, we propose a novel method that is capable of making the artery/vein (A/V) distinction in retinal color fundus images based on vascular network topological properties. To this end, we adapt the concept of dominant set clustering and formalize the retinal blood vessel topology estimation and the A/V classification as a pairwise clustering problem. The graph is constructed through image segmentation, skeletonization, and identification of significant nodes. The edge weight is defined as the inverse Euclidean distance between its two end points in the feature space of intensity, orientation, curvature, diameter, and entropy. The reconstructed vascular network is classified into arteries and veins based on their intensity and morphology. The proposed approach has been applied to five public databases, namely INSPIRE, IOSTAR, VICAVR, DRIVE, and WIDE, and achieved high accuracies of 95.1%, 94.2%, 93.8%, 91.1%, and 91.0%, respectively. Furthermore, we have made manual annotations of the blood vessel topologies for INSPIRE, IOSTAR, VICAVR, and DRIVE datasets, and these annotations are released for public access so as to facilitate researchers in the community.

engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
Joint 2D attention gate and channel-spatial attention network for retinal vessel segmentation of OCT-angiography images

Baoyu Cui,Sumin Qi,Jing Meng,Yingjie Jiang

DOI: https://doi.org/10.1007/s11760-022-02329-6

2022-08-06

Abstract:OCT-angiography is a non-invasive visualization imaging technology with high resolution that can more clearly image tiny blood vessels. Certain ophthalmic diseases can be diagnosed by the morphological changes of retinal blood vessels, and the automatic segmentation of blood vessel will definitely reduce workload of ophthalmologists. Current segmentation methods result in the loss of important detailed features and the segmenting failure of tiny blood vessels. We propose a joint 2D attention gate and channel-spatial attention network for the retinal vessel segmentation of OCT-angiography images to improve accuracy and reduce error rate. The improved 2D attention gate introduces attention coefficients to increase the weight of the blood vessel area, which preserves the branch structure and edge information of tiny blood vessels to a greater extent by combining context feature information of different levels of units. The channel-spatial attention block is used to enhance channel and spatial channel information, respectively. To enhance the credibility, our network was tested on two public data sets. Compared with channel and spatial attention network, U-Net with residual block and U-Net, the important indicator of accuracy is increased by 1.97%, 2.18% and 3.04%, respectively, in data set I and increased by 0.18%, 0.19% and 0.62%, respectively, in data set II.

engineering, electrical & electronic,imaging science & photographic technology
An improved method for retinal vessel segmentation in U-Net

Chunyang Li,Zhigang Li,Fusheng Yu,Weikang Liu,Li, Chunyang,Li, Zhigang,Liu, Weikang

DOI: https://doi.org/10.1007/s11042-024-18757-0

IF: 2.577

2024-03-06

Multimedia Tools and Applications

Abstract:The utilization of retinal vessel images is prevalent in the diagnosis of numerous diseases, such as chronic vascular diseases, diabetic retinopathy, and glaucoma. Despite the U-Net model's effective performance in retinal vessel imaging, it has been observed that the U-Net model fails to adequately detect dense blood vessels and vascular bifurcation. This research proposes a retinal vessel segmentation model that is both efficient and straightforward. The study introduces two significant contributions. Firstly, the multi-scale structure is improved, and a feature circulation module is added to enhance the detection of blood vessels. Secondly, an AGM module is incorporated into the jump connection to boost the transmission of context characteristics and suppress background noise. The presented model is assessed using publicly available DRIVE and STARE datasets. The proposed method and U-Net evaluation results are quantitatively and qualitatively analyzed, alongside a comparison with current state-of-the-art algorithms. By conducting a comparative analysis, certain algorithmic indices have exhibited state-of-the-art performance. The AttMSFCU-Net model, as introduced in this study, achieves advanced or comparable accuracy levels when evaluated on both the DRIVE and STARE datasets. Of particular note is the enhanced segmentation performance of dense and bifurcation vessels. The evaluation of the proposed model on the DRIVE and STARE datasets highlights its robustness and accuracy, affirming its utility in practical applications.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Multi-level spatial-temporal and attentional information deep fusion network for retinal vessel segmentation

Yi Huang,Tao Deng

DOI: https://doi.org/10.1088/1361-6560/acefa0

IF: 3.5

2023-08-13

Physics in Medicine and Biology

Abstract:Objective. Automatic segmentation of fundus vessels has the potential to enhance the judgment ability of intelligent disease diagnosis systems. Even though various methods have been proposed, it's still a demanding task to accurately segment the fundus vessels. The purpose of our study is to develop a robust and effective method to segment the vessels in human color retinal fundus images. Approach. We present a novel multi-level spatial-temporal and attentional information deep fusion network for the segmentation of retinal vessels, called MSAFNet, which enhances segmentation performance and robustness. Our method utilizes the Multi-level Spatial- temporal Encoding module to obtain spatial-temporal information and the Self- Attention module to capture feature correlations in different levels of our network. Based on the encoder and decoder structure, we combine these features to get the final segmentation results. Main results. Through abundant experiments on four public datasets, our method achieves preferable performance compared with other SOTA retinal vessel segmentation methods. Our ACC and AUC achieve the highest scores of 96.96%, 96.57%, 96.48% and 98.78%, 98.54%, 98.27% on DRIVE, CHASE DB1, and HRF datasets. Our SP achieves the highest score of 98.58% and 99.08% on DRIVE and STARE datasets. Significance. The experimental results demonstrate that our method has strong learning and representation capabilities and can accurately detect retinal blood vessels, thereby serving as a potential tool for assisting in diagnosis.

engineering, biomedical,radiology, nuclear medicine & medical imaging
A retinal vessel segmentation network with multiple-dimension attention and adaptive feature fusion

Jianyong Li,Ge Gao,Lei Yang,Yanhong Liu

DOI: https://doi.org/10.1016/j.compbiomed.2024.108315

IF: 7.7

2024-03-18

Computers in Biology and Medicine

Abstract:The incidence of blinding eye diseases is highly correlated with changes in retinal morphology, and is clinically detected by segmenting retinal structures in fundus images. However, some existing methods have limitations in accurately segmenting thin vessels. In recent years, deep learning has made a splash in the medical image segmentation, but the lack of edge information representation due to repetitive convolution and pooling, limits the final segmentation accuracy. To this end, this paper proposes a pixel-level retinal vessel segmentation network with multiple-dimension attention and adaptive feature fusion. Here, a multiple dimension attention enhancement (MDAE) block is proposed to acquire more local edge information. Meanwhile, a deep guidance fusion (DGF) block and a cross-pooling semantic enhancement (CPSE) block are proposed simultaneously to acquire more global contexts. Further, the predictions of different decoding stages are learned and aggregated by an adaptive weight learner (AWL) unit to obtain the best weights for effective feature fusion. The experimental results on three public fundus image datasets show that proposed network could effectively enhance the segmentation performance on retinal blood vessels. In particular, the proposed method achieves AUC of 98.30%, 98.75%, and 98.71% on the DRIVE, CHASE_DB1, and STARE datasets, respectively, while the F1 score on all three datasets exceeded 83%. The source code of the proposed model is available at https://github.com/gegao310/VesselSeg-Pytorch-master .

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
Multi-scale Neural Networks for Retinal Blood Vessels Segmentation

Boheng Zhang,Shenglei Huang,Shaohan Hu

DOI: https://doi.org/10.48550/arXiv.1804.04206

2018-04-12

Abstract:Existing supervised approaches didn't make use of the low-level features which are actually effective to this task. And another deficiency is that they didn't consider the relation between pixels, which means effective features are not extracted. In this paper, we proposed a novel convolutional neural network which make sufficient use of low-level features together with high-level features and involves atrous convolution to get multi-scale features which should be considered as effective features. Our model is tested on three standard benchmarks - DRIVE, STARE, and CHASE databases. The results presents that our model significantly outperforms existing approaches in terms of accuracy, sensitivity, specificity, the area under the ROC curve and the highest prediction speed. Our work provides evidence of the power of wide and deep neural networks in retinal blood vessels segmentation task which could be applied on other medical images tasks.

Computer Vision and Pattern Recognition,Machine Learning
MS-CANet: Multi-Scale Subtraction Network with Coordinate Attention for Retinal Vessel Segmentation

Yun Jiang,Wei Yan,Jie Chen,Hao Qiao,Zequn Zhang,Meiqi Wang

DOI: https://doi.org/10.3390/sym15040835

2023-03-31

Symmetry

Abstract:Retinal vessel segmentation is crucial in the diagnosis of certain ophthalmic and cardiovascular diseases. Although U-shaped networks have been widely used for retinal vessel segmentation, most of the improved methods have insufficient feature extraction capability and fuse different network layers using element or dimension summation, leading to redundant information and inaccurate retinal vessel localization with blurred vessel edges. The asymmetry of small blood vessels in fundus images also increases the difficulty of segmenting blood vessels. To overcome these challenges, we propose a novel multi-scale subtraction network (MS-CANet) with residual coordinate attention to segment the vessels in retinal vessel images. Our approach incorporates a residual coordinate attention module during the encoding phase, which captures long-range spatial dependencies while preserving precise position information. To obtain rich multi-scale information, we also include multi-scale subtraction units at different perceptual field levels. Moreover, we introduce a parallel channel attention module that enhances the contrast between vessel and background, thereby improving the detection of marginal vessels during the decoding phase. We validate our proposed model on three benchmark datasets, namely DRIVE, CHASE, and STARE. The results demonstrate that our method outperforms most advanced methods under different evaluation metrics.

multidisciplinary sciences
Automatic Artery/Vein Classification Using a Vessel-Constraint Network for Multicenter Fundus Images

Jingfei Hu,Hua Wang,Zhaohui Cao,Guang Wu,Jost B. Jonas,Ya Xing Wang,Jicong Zhang

DOI: https://doi.org/10.3389/fcell.2021.659941

IF: 5.5

2021-06-11

Frontiers in Cell and Developmental Biology

Abstract:Retinal blood vessel morphological abnormalities are generally associated with cardiovascular, cerebrovascular, and systemic diseases, automatic artery/vein (A/V) classification is particularly important for medical image analysis and clinical decision making. However, the current method still has some limitations in A/V classification, especially the blood vessel edge and end error problems caused by the single scale and the blurred boundary of the A/V. To alleviate these problems, in this work, we propose a vessel-constraint network (VC-Net) that utilizes the information of vessel distribution and edge to enhance A/V classification, which is a high-precision A/V classification model based on data fusion. Particularly, the VC-Net introduces a vessel-constraint (VC) module that combines local and global vessel information to generate a weight map to constrain the A/V features, which suppresses the background-prone features and enhances the edge and end features of blood vessels. In addition, the VC-Net employs a multiscale feature (MSF) module to extract blood vessel information with different scales to improve the feature extraction capability and robustness of the model. And the VC-Net can get vessel segmentation results simultaneously. The proposed method is tested on publicly available fundus image datasets with different scales, namely, DRIVE, LES, and HRF, and validated on two newly created multicenter datasets: Tongren and Kailuan. We achieve a balance accuracy of 0.9554 and F1 scores of 0.7616 and 0.7971 for the arteries and veins, respectively, on the DRIVE dataset. The experimental results prove that the proposed model achieves competitive performance in A/V classification and vessel segmentation tasks compared with state-of-the-art methods. Finally, we test the Kailuan dataset with other trained fusion datasets, the results also show good robustness. To promote research in this area, the Tongren dataset and source code will be made publicly available. The dataset and code will be made available at https://github.com/huawang123/VC-Net .

cell biology,developmental biology
Automated segmentaiton and classification of arterioles and venules using Cascading Dilated Convolutional Neural Networks

Meng Li,Yan Zhang,Haicheng She,Jinqiong Zhou,Jia Jia,Danmei He,Li Zhang

DOI: https://doi.org/10.48550/arXiv.1812.00137

2018-12-01

Computer Vision and Pattern Recognition

Abstract:The change of retinal vasculature is an early sign of many vascular and systematic diseases, such as diabetes and hypertension. Different behaviors of retinal arterioles and venules form an important metric to measure the disease severity. Therefore, an accurate classification of arterioles and venules is of great necessity. In this work, we propose a novel architecture of deep convolutional neural network for segmenting and classifying arterioles and venules on retinal fundus images. This network takes the original color fundus image as inputs and multi-class labels as outputs. We adopt the encoding-decoding structure (Unet) as the backbone network of our proposed model. To improve the classification accuracy, we develop a special encoding path that couples InceptionV4 modules and Cascading Dilated Convolutions (CDCs) on top of the backbone network. The model is thus able to extract and fuse high-level semantic features from multi-scale receptive fields. The proposed method has outperformed the previous state-of-the-art method on DRIVE dataset with an accuracy of 0.955 $\pm$ 0.002.
Exploiting Cross-Scale Attention Transformer and Progressive Edge Refinement for Retinal Vessel Segmentation

Yunyi Yuan,Yingkui Zhang,Lei Zhu,Li Cai,Yinling Qian

DOI: https://doi.org/10.3390/math12020264

IF: 2.4

2024-01-13

Mathematics

Abstract:Accurate retinal vessel segmentation is a crucial step in the clinical diagnosis and treatment of fundus diseases. Although many efforts have been presented to address the task, the segmentation performance in challenging regions (e.g., collateral vessels) is still not satisfactory, due to their thin morphology or the low contrast between foreground and background. In this work, we observe that an intrinsic appearance exists in the retinal image: among the dendritic vessels there are generous similar structures, e.g., the main and collateral vessels are all curvilinear, but they have noticeable scale differences. Based on this observation, we propose a novel cross-scale attention transformer (CAT) to encourage the segmentation effects in challenging regions. Specifically, CAT consumes features with different scales to produce their shared attention matrix, and then fully integrates the beneficial information between them. Such new attention architecture could explore the multi-scale idea more efficiently, thus realizing mutual learning of similar structures. In addition, a progressive edge refinement module (ERM) is designed to refine the edges of foreground and background in the segmentation results. Through the idea of edge decoupling, ERM could suppress the background feature near the blood vessels while enhancing the foreground feature, so as to segment vessels accurately. We conduct extensive experiments and discussions on DRIVE and CHASE_DB1 datasets to verify the proposed framework. Experimental results show that our method has great advantages in the Se metric, which are 0.88–7.26% and 0.81–7.11% higher than the state-of-the-art methods on DRIVE and CHASE_DB1, respectively. In addition, the proposed method also outperforms other methods with 0.17–2.06% in terms of the Dice metric on DRIVE.

mathematics
High-precision retinal blood vessel segmentation based on a multi-stage and dual-channel deep learning network

Hui Guo,Jing Meng,Yong Fu Zhao,Hong Dong Zhang,Cuixia Dai

DOI: https://doi.org/10.1088/1361-6560/ad1cf6

IF: 3.5

2024-01-11

Physics in Medicine and Biology

Abstract:Objective. The high-precision segmentation of retinal vessels in fundus images is important for the early diagnosis of ophthalmic diseases. However, the extraction for microvessels is challenging due to their characteristics of low contrast and high structure complexity. Although some works have been developed to improve the segmentation ability in thin vessels, they are just successful in recognizing the small vessels with relative high contrast. Approach. Therefore, we develop a deep learning (DL) framework with multi-stage and dual-channel network model (MSDC_NET) to further improve the thin-vessel segmentation with low contrast. Specifically, an adaptive image enhancement strategy combining multiple pre-processing and DL method is firstly proposed to elevate the contrast of thin vessels; then, a two-channel model with multi-scale perception is developed to implement the whole- and thin-vessel segmentation; and finally, a series of post-processing operations are designed to extract more small vessels in the predicted maps from thin-vessel channel. Main results. Experiments on DRIVE, STARE and CHASE_DB1 demonstrate the superiorities of the proposed MSDC_NET on extracting more thin vessels in fundus images, and the quantitative evaluations on several parameters based on the advanced ground truth further verify the advantages of our proposed DL model. Compared with the previous multi-branch method, the specificity and F1 score are improved about 2.18%, 0.68%, 1.73% and 2.91%, 0.24%, 8.38% on the three datasets, respectively. Significance. This work may provide richer information to ophthalmologists for diagnosis and treatment of vascular-related ophthalmic diseases.

engineering, biomedical,radiology, nuclear medicine & medical imaging
Skeleton-guided multi-scale dual-coordinate attention aggregation network for retinal blood vessel segmentation

Wei Zhou,Xiaorui Wang,Xuekun Yang,Yangtao Hu,Yugen Yi

DOI: https://doi.org/10.1016/j.compbiomed.2024.109027

2024-08-22

Abstract:Deep learning plays a pivotal role in retinal blood vessel segmentation for medical diagnosis. Despite their significant efficacy, these techniques face two major challenges. Firstly, they often neglect the severe class imbalance in fundus images, where thin vessels in the foreground are proportionally minimal. Secondly, they are susceptible to poor image quality and blurred vessel edges, resulting in discontinuities or breaks in vascular structures. In response, this paper proposes the Skeleton-guided Multi-scale Dual-coordinate Attention Aggregation (SMDAA) network for retinal vessel segmentation. SMDAA comprises three innovative modules: Dual-coordinate Attention (DCA), Unbalanced Pixel Amplifier (UPA), and Vessel Skeleton Guidance (VSG). DCA, integrating Multi-scale Coordinate Feature Aggregation (MCFA) and Scale Coordinate Attention Decoding (SCAD), meticulously analyzes vessel structures across various scales, adept at capturing intricate details, thereby significantly enhancing segmentation accuracy. To address class imbalance, we introduce UPA, dynamically allocating more attention to misclassified pixels, ensuring precise extraction of thin and small blood vessels. Moreover, to preserve vessel structure continuity, we integrate vessel anatomy and develop the VSG module to connect fragmented vessel segments. Additionally, a Feature-level Contrast (FCL) loss is introduced to capture subtle nuances within the same category, enhancing the fidelity of retinal blood vessel segmentation. Extensive experiments on three public datasets (DRIVE, STARE, and CHASE_DB1) demonstrate superior performance in comparison to current methods. The code is available at https://github.com/wangwxr/SMDAA_NET.

Studies on proteins of animal ribosomes. XII. Determination of molecular weights of ribosomal proteins by SDS Gel electrophoresis.

Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

Fully Automated Tree Topology Estimation and Artery-Vein Classification

Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation

Multi-Task Neural Networks with Spatial Activation for Retinal Vessel Segmentation and Artery/Vein Classification

Fundus vascular image segmentation based on multiple attention mechanisms and deep learning

A combination of multi‐scale and attention based on the U‐shaped network for retinal vessel segmentation

Multi-scale Interactive Network with Artery/Vein Discriminator for Retinal Vessel Classification

A high resolution representation network with multi-path scale for retinal vessel segmentation

Retinal Vascular Network Topology Reconstruction and Artery/Vein Classification via Dominant Set Clustering

Joint 2D attention gate and channel-spatial attention network for retinal vessel segmentation of OCT-angiography images

An improved method for retinal vessel segmentation in U-Net

Multi-level spatial-temporal and attentional information deep fusion network for retinal vessel segmentation

A retinal vessel segmentation network with multiple-dimension attention and adaptive feature fusion

Multi-scale Neural Networks for Retinal Blood Vessels Segmentation

MS-CANet: Multi-Scale Subtraction Network with Coordinate Attention for Retinal Vessel Segmentation

Automatic Artery/Vein Classification Using a Vessel-Constraint Network for Multicenter Fundus Images

Automated segmentaiton and classification of arterioles and venules using Cascading Dilated Convolutional Neural Networks

Exploiting Cross-Scale Attention Transformer and Progressive Edge Refinement for Retinal Vessel Segmentation

High-precision retinal blood vessel segmentation based on a multi-stage and dual-channel deep learning network

Skeleton-guided multi-scale dual-coordinate attention aggregation network for retinal blood vessel segmentation