Abstract:Retinal blood vessel morphological abnormalities are generally associated with cardiovascular, cerebrovascular, and systemic diseases, automatic artery/vein (A/V) classification is particularly important for medical image analysis and clinical decision making. However, the current method still has some limitations in A/V classification, especially the blood vessel edge and end error problems caused by the single scale and the blurred boundary of the A/V. To alleviate these problems, in this work, we propose a vessel-constraint network (VC-Net) that utilizes the information of vessel distribution and edge to enhance A/V classification, which is a high-precision A/V classification model based on data fusion. Particularly, the VC-Net introduces a vessel-constraint (VC) module that combines local and global vessel information to generate a weight map to constrain the A/V features, which suppresses the background-prone features and enhances the edge and end features of blood vessels. In addition, the VC-Net employs a multiscale feature (MSF) module to extract blood vessel information with different scales to improve the feature extraction capability and robustness of the model. And the VC-Net can get vessel segmentation results simultaneously. The proposed method is tested on publicly available fundus image datasets with different scales, namely, DRIVE, LES, and HRF, and validated on two newly created multicenter datasets: Tongren and Kailuan. We achieve a balance accuracy of 0.9554 and F1 scores of 0.7616 and 0.7971 for the arteries and veins, respectively, on the DRIVE dataset. The experimental results prove that the proposed model achieves competitive performance in A/V classification and vessel segmentation tasks compared with state-of-the-art methods. Finally, we test the Kailuan dataset with other trained fusion datasets, the results also show good robustness. To promote research in this area, the Tongren dataset and source code will be made publicly available. The dataset and code will be made available at https://github.com/huawang123/VC-Net .

A-line-based Thin-Cap Fibroatheroma Detection with Multi-View IVOCT Images Using Multi-Task Learning and Contrastive Learning

Detection of Thin-Cap Fibroatheroma in IVOCT Images Based on Weakly Supervised Learning and Domain Knowledge

Multi-view Contour-constrained Transformer Network for Thin-cap Fibroatheroma Identification

Continuous Extraction of Coronary Artery Centerline from Cardiac CTA Images Using a Regression-Based Method.

Deep learning segmentation of fibrous cap in intravascular optical coherence tomography images

Fibroatheroma Identification in Intravascular Optical Coherence Tomography Images Using Deep Features

FiAt-Net: Detecting Fibroatheroma Plaque Cap in 3D Intravascular OCT Images

Automatic Classification of Atherosclerotic Tissue in Intravascular Optical Coherence Tomography Images

Automatic Thin Cap Fibroatheroma Detection Using Fusion of Intravascular Ultrasound and Virtual Histology Images

Location-specific prediction of vulnerable plaque using IVUS, virtual histology, and spatial context

Automatic classification and segmentation of atherosclerotic plaques in the intravascular optical coherence tomography (IVOCT)

Retinal Structure Detection in OCTA Image via Voting-Based Multitask Learning

Automated detection of vulnerable plaque in intravascular ultrasound images

Automatic Artery/Vein Classification Using a Vessel-Constraint Network for Multicenter Fundus Images

Identification of Atherosclerotic Plaques in Intravascular Optical Coherence Tomography Images Based on Textures and Artificial Neural Network

Vision Transformer Based Multi-class Lesion Detection in IVOCT

Multi-class plaque segmentation in Intravascular Ultrasound via inter-frame feature fusion and contrast feature extraction

Intravascular Optical Coherence Tomography Image Segmentation Based on Support Vector Machine Algorithm

The Correlation Between Texture Features and Fibrous Cap Thickness of Lipid-Rich Atheroma Based on Optical Coherence Tomography Imaging

Multi-task learning with Multi-view Weighted Fusion Attention for artery-specific calcification analysis