Neurovascular Segmentation in sOCT with Deep Learning and Synthetic Training Data

Etienne Chollet,Yaël Balbastre,Chiara Mauri,Caroline Magnain,Bruce Fischl,Hui Wang

2024-07-02

Abstract:Microvascular anatomy is known to be involved in various neurological disorders. However, understanding these disorders is hindered by the lack of imaging modalities capable of capturing the comprehensive three-dimensional vascular network structure at microscopic resolution. With a lateral resolution of $<=$20 {\textmu}m and ability to reconstruct large tissue blocks up to tens of cubic centimeters, serial-section optical coherence tomography (sOCT) is well suited for this task. This method uses intrinsic optical properties to visualize the vessels and therefore does not possess a specific contrast, which complicates the extraction of accurate vascular models. The performance of traditional vessel segmentation methods is heavily degraded in the presence of substantial noise and imaging artifacts and is sensitive to domain shifts, while convolutional neural networks (CNNs) require extensive labeled data and are also sensitive the precise intensity characteristics of the data that they are trained on. Building on the emerging field of synthesis-based training, this study demonstrates a synthesis engine for neurovascular segmentation in sOCT images. Characterized by minimal priors and high variance sampling, our highly generalizable method tested on five distinct sOCT acquisitions eliminates the need for manual annotations while attaining human-level precision. Our approach comprises two phases: label synthesis and label-to-image transformation. We demonstrate the efficacy of the former by comparing it to several more realistic sets of training labels, and the latter by an ablation study of synthetic noise and artifact models.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

This paper focuses on the problem of neural vessel segmentation in optical coherence tomography (sOCT). sOCT is an imaging technique that can capture the three-dimensional vascular network structure with micron-level resolution, but its lack of specific contrast makes accurate vessel extraction complex, especially in the presence of noise and imaging artifacts. Traditional vessel segmentation methods, such as those based on the Hessian filter, perform poorly when dealing with irregular vessels, crossing tissue boundaries, or low contrast-to-noise ratio (CNR). The paper proposes a neural vessel segmentation method based on deep learning and synthetic training data. This method eliminates the need for manual annotation by using minimal prior knowledge and high-variance sampling, while achieving human-level accuracy. The method consists of two stages: label synthesis and label-to-image translation. The training data generated by the synthesis engine overcomes the reliance of traditional convolutional neural networks (CNNs) on large amounts of high-quality annotated data and the sensitivity to specific intensity features of the data. Experiments show that the model trained using synthetic data exhibits comparable accuracy to manually annotated data in five different sOCT acquisitions, without being limited by actual imaging data and annotations. The paper also compares the impact of noise and artifact elimination models on the performance of the model, demonstrating the crucial role of the noise model in improving segmentation accuracy. In summary, this paper aims to address the challenges of vessel segmentation in sOCT images and improve the accuracy and robustness of vessel segmentation using a deep learning model trained on synthetic data.

Neurovascular Segmentation in sOCT with Deep Learning and Synthetic Training Data

Generative Adversarial Network Based Cerebrovascular Segmentation for Time-of-flight Magnetic Resonance Angiography Image

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

A label-free and data-free training strategy for vasculature segmentation in serial sectioning OCT data

Synthetic optical coherence tomography angiographs for detailed retinal vessel segmentation without human annotations

Simulation-Based Segmentation of Blood Vessels in Cerebral 3D OCTA Images

Structure attention co‐training neural network for neovascularization segmentation in intravascular optical coherence tomography

Improving Cerebral Microvascular Image Quality of Optical Coherence Tomography Angiography with Deep Learning-Based Segmentation.

Microvasculature Segmentation and Inter-capillary Area Quantification of the Deep Vascular Complex using Transfer Learning

A Sparse Deep Learning Approach for Automatic Segmentation of Human Vasculature in Multispectral Optoacoustic Tomography

Segmentation of Low-Light Optical Coherence Tomography Angiography Images under the Constraints of Vascular Network Topology

Automated segmentation of microvessels in intravascular OCT images using deep learning

Synthetic Data for Robust Stroke Segmentation

Automatic Segmentation and Visualization of Choroid in OCT with Knowledge Infused Deep Learning

Enhanced Multiscale Human Brain Imaging by Semi-supervised Digital Staining and Serial Sectioning Optical Coherence Tomography

Automatic choroidal segmentation in OCT images using supervised deep learning methods

Automated Segmentation of Choroidal Neovascularization in Optical Coherence Tomography Images Using Multi-Scale Convolutional Neural Networks with Structure Prior

Real-Time Cerebral Vessel Segmentation in Laser Speckle Contrast Image Based on Unsupervised Domain Adaptation

Topology guaranteed segmentation of the human retina from OCT using convolutional neural networks

Synthetic OCT Data Generation to Enhance the Performance of Diagnostic Models for Neurodegenerative Diseases

Robust Deep Learning Method for Choroidal Vessel Segmentation on Swept Source Optical Coherence Tomography Images