Microvasculature Segmentation and Inter-capillary Area Quantification of the Deep Vascular Complex using Transfer Learning

Julian Lo,Morgan Heisler,Vinicius Vanzan,Sonja Karst,Ivana Zadro Matovinovic,Sven Loncaric,Eduardo V. Navajas,Mirza Faisal Beg,Marinko V. Sarunic
DOI: https://doi.org/10.1167/tvst.9.2.38
2020-03-20
Abstract:Purpose: Optical Coherence Tomography Angiography (OCT-A) permits visualization of the changes to the retinal circulation due to diabetic retinopathy (DR), a microvascular complication of diabetes. We demonstrate accurate segmentation of the vascular morphology for the superficial capillary plexus and deep vascular complex (SCP and DVC) using a convolutional neural network (CNN) for quantitative analysis. Methods: Retinal OCT-A with a 6x6mm field of view (FOV) were acquired using a Zeiss PlexElite. Multiple-volume acquisition and averaging enhanced the vessel network contrast used for training the CNN. We used transfer learning from a CNN trained on 76 images from smaller FOVs of the SCP acquired using different OCT systems. Quantitative analysis of perfusion was performed on the automated vessel segmentations in representative patients with DR. Results: The automated segmentations of the OCT-A images maintained the hierarchical branching and lobular morphologies of the SCP and DVC, respectively. The network segmented the SCP with an accuracy of 0.8599, and a Dice index of 0.8618. For the DVC, the accuracy was 0.7986, and the Dice index was 0.8139. The inter-rater comparisons for the SCP had an accuracy and Dice index of 0.8300 and 0.6700, respectively, and 0.6874 and 0.7416 for the DVC. Conclusions: Transfer learning reduces the amount of manually-annotated images required, while producing high quality automatic segmentations of the SCP and DVC. Using high quality training data preserves the characteristic appearance of the capillary networks in each layer. Translational Relevance: Accurate retinal microvasculature segmentation with the CNN results in improved perfusion analysis in diabetic retinopathy.
Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Quantitative Methods
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is to improve the accuracy of microvascular segmentation and quantitative analysis of the Deep Vascular Complex (DVC) through the use of transfer learning. Specifically, the goals of the paper include: 1. **Improve the accuracy of microvascular segmentation**: Use the Convolutional Neural Network (CNN) to perform high - precision automatic segmentation of the Superficial Capillary Plexus (SCP) and the Deep Vascular Complex (DVC). This helps to more accurately identify and analyze changes in the retinal microvascular structure. 2. **Reduce the need for manual annotation**: Through transfer learning, reduce the number of manually annotated images required for training the model. This can not only save time and resources but also improve the generalization ability of the model. 3. **Improve the diagnosis and treatment of diabetic retinopathy**: By improving the accuracy of microvascular segmentation, the retinal blood flow perfusion can be better quantified, thereby providing support for the early diagnosis and treatment of diabetic retinopathy (DR). ### Method overview - **Data collection**: Use the Zeiss PlexElite device to obtain Optical Coherence Tomography Angiography (OCT - A) images with a 6x6mm field of view. - **Transfer learning**: Start from a CNN model that has been trained on SCP images with a smaller field of view (2x2mm and 3x3mm), and adapt it to DVC images with a 6x6mm field of view through fine - tuning. - **Performance evaluation**: Evaluate the performance of different networks by calculating the accuracy of the segmentation results and the Dice Similarity Coefficient (DSC). ### Main results - **Segmentation accuracy**: - For SCP, the accuracy of network C (the fine - tuned network) is 0.8599, and the Dice index is 0.8618. - For DVC, the accuracy of network C is 0.7986, and the Dice index is 0.8139. - **Comparison with manual annotation**: - The segmentation of SCP reaches 0.8300 and 0.6700 in terms of accuracy and Dice index respectively. - The segmentation of DVC reaches 0.6874 and 0.7416 in terms of accuracy and Dice index respectively. ### Conclusion Through transfer learning, the research team has successfully reduced the number of manually annotated images and achieved high - quality automatic segmentation on single - frame OCT - A images with a 6x6mm field of view. This not only improves the accuracy of segmentation but also provides strong support for the clinical diagnosis and treatment of diabetic retinopathy. ### Transformation significance Accurate retinal microvascular segmentation and quantitative analysis can significantly improve the perfusion analysis of diabetic retinopathy, thereby accelerating the formulation of treatment plans and improving the prognosis.