Abstract:We present DeepVesselNet, an architecture tailored to the challenges faced when extracting vessel trees and networks and corresponding features in 3-D angiographic volumes using deep learning. We discuss the problems of low execution speed and high memory requirements associated with full 3-D networks, high-class imbalance arising from the low percentage (<3%) of vessel voxels, and unavailability of accurately annotated 3-D training data—and offer solutions as the building blocks of DeepVesselNet. First, we formulate 2-D orthogonal cross-hair filters which make use of 3-D context information at a reduced computational burden. Second, we introduce a class balancing cross-entropy loss function with false-positive rate correction to handle the high-class imbalance and high false positive rate problems associated with existing loss functions. Finally, we generate a synthetic dataset using a computational angiogenesis model capable of simulating vascular tree growth under physiological constraints on local network structure and topology and use these data for transfer learning. We demonstrate the performance on a range of angiographic volumes at different spatial scales including clinical MRA data of the human brain, as well as CTA microscopy scans of the rat brain. Our results show that cross-hair filters achieve over 23% improvement in speed, lower memory footprint, lower network complexity which prevents overfitting and comparable accuracy that does not differ from full 3-D filters. Our class balancing metric is crucial for training the network, and transfer learning with synthetic data is an efficient, robust, and very generalizable approach leading to a network that excels in a variety of angiography segmentation tasks. We observe that sub-sampling and max pooling layers may lead to a drop in performance in tasks that involve voxel-sized structures. To this end, the DeepVesselNet architecture does not use any form of sub-sampling layer and works well for vessel segmentation, centerline prediction, and bifurcation detection. We make our synthetic training data publicly available, fostering future research, and serving as one of the first public datasets for brain vessel tree segmentation and analysis.

Optimized U-Net model for 3D light-sheet image segmentation of zebrafish trunk vessels

VesselNet: A deep convolutional neural network with multi pathways for robust hepatic vessel segmentation

Real-time Water Area Segmentation for USV using Enhanced U-Net

In-vivo 3D imaging of Zebrafish’s intersegmental vessel development by a bi-directional light-sheet illumination microscope

Three-dimensional cerebral vasculature topological parameter extraction of transgenic zebrafish embryos with a filling-enhancement deep learning network

A Machine Learning Method for Automated In Vivo Transparent Vessel Segmentation and Identification Based on Blood Flow Characteristics

Automated cell tracking using 3D nnUnet and Light Sheet Microscopy to quantify regional deformation in zebrafish

An improved method for retinal vessel segmentation in U-Net

3D quantification of zebrafish cerebrovascular architecture by automated image analysis of light sheet fluorescence microscopy datasets

Automatic Segmentation of Coronary Lumen and External Elastic Membrane in Intravascular Ultrasound Images Using 8-Layer U-Net

Ultrasound Bio-Microscopic Image Segmentation for Evaluation of Zebrafish Cardiac Function

Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation

U-Net based vessel segmentation for murine brains with small micro-magnetic resonance imaging reference datasets

A lightweight underwater fish image semantic segmentation model based on U‐Net

A multi-scale feature extraction and fusion-based model for retinal vessel segmentation in fundus images

A U-Net Deep Learning Framework for High Performance Vessel Segmentation in Patients With Cerebrovascular Disease

LiViT-Net: A U-Net-like, lightweight Transformer network for retinal vessel segmentation

Zebrafish vascular quantification: a tool for quantification of three-dimensional zebrafish cerebrovascular architecture by automated image analysis

Leveraging Frequency Domain Learning in 3D Vessel Segmentation

GAEI-UNet: Global Attention and Elastic Interaction U-Net for Vessel Image Segmentation

DeepVesselNet: Vessel Segmentation, Centerline Prediction, and Bifurcation Detection in 3-D Angiographic Volumes