Abstract:We present DeepVesselNet, an architecture tailored to the challenges faced when extracting vessel trees and networks and corresponding features in 3-D angiographic volumes using deep learning. We discuss the problems of low execution speed and high memory requirements associated with full 3-D networks, high-class imbalance arising from the low percentage (<3%) of vessel voxels, and unavailability of accurately annotated 3-D training data—and offer solutions as the building blocks of DeepVesselNet. First, we formulate 2-D orthogonal cross-hair filters which make use of 3-D context information at a reduced computational burden. Second, we introduce a class balancing cross-entropy loss function with false-positive rate correction to handle the high-class imbalance and high false positive rate problems associated with existing loss functions. Finally, we generate a synthetic dataset using a computational angiogenesis model capable of simulating vascular tree growth under physiological constraints on local network structure and topology and use these data for transfer learning. We demonstrate the performance on a range of angiographic volumes at different spatial scales including clinical MRA data of the human brain, as well as CTA microscopy scans of the rat brain. Our results show that cross-hair filters achieve over 23% improvement in speed, lower memory footprint, lower network complexity which prevents overfitting and comparable accuracy that does not differ from full 3-D filters. Our class balancing metric is crucial for training the network, and transfer learning with synthetic data is an efficient, robust, and very generalizable approach leading to a network that excels in a variety of angiography segmentation tasks. We observe that sub-sampling and max pooling layers may lead to a drop in performance in tasks that involve voxel-sized structures. To this end, the DeepVesselNet architecture does not use any form of sub-sampling layer and works well for vessel segmentation, centerline prediction, and bifurcation detection. We make our synthetic training data publicly available, fostering future research, and serving as one of the first public datasets for brain vessel tree segmentation and analysis.

SPIRONet: Spatial-Frequency Learning and Topological Channel Interaction Network for Vessel Segmentation

VesselNet: A deep convolutional neural network with multi pathways for robust hepatic vessel segmentation

Generative Adversarial Network Based Cerebrovascular Segmentation for Time-of-flight Magnetic Resonance Angiography Image

Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation

3D Pyramidal Densely Connected Network with Cross-Frame Uncertainty Guidance for Intravascular Ultrasound Sequence Segmentation.

Sequential Vessel Segmentation Via Deep Channel Attention Network

Spatio-Temporal Correspondence Attention Network for Vessel Segmentation in X-ray Coronary Angiography

CSDN: Combing Shallow and Deep Networks for Accurate Real-time Segmentation of High-definition Intravascular Ultrasound Images

Leveraging Frequency Domain Learning in 3D Vessel Segmentation

DeepVesselNet: Vessel Segmentation, Centerline Prediction, and Bifurcation Detection in 3-D Angiographic Volumes

SS-Net: 3D Spatial-Spectral Network for Cerebrovascular Segmentation in TOF-MRA

Robust vascular segmentation for raw complex images of laser speckle contrast based on weakly supervised learning

FS-Net: Full Scale Network and Adaptive Threshold for Improving Extraction of Micro-Retinal Vessel Structures

Real-Time Cerebral Vessel Segmentation in Laser Speckle Contrast Image Based on Unsupervised Domain Adaptation

Automated segmentation of metal stent and bioresorbable vascular scaffold in intravascular optical coherence tomography images using deep learning architectures

SFNet: Spatial and Frequency Domain Networks for Wide‐Field OCT Angiography Retinal Vessel Segmentation

Off-Enet: An Optimally Fused Fully End-To-End Network For Automatic Dense Volumetric 3d Intracranial Blood Vessels Segmentation

A high resolution representation network with multi-path scale for retinal vessel segmentation

Landmark-Assisted Anatomy-Sensitive Retinal Vessel Segmentation Network

A Deep Segmentation Network of Multi-Scale Feature Fusion Based on Attention Mechanism for IVOCT Lumen Contour

Image Magnification Network for Vessel Segmentation in OCTA Images