Abstract:Purpose: Vessel segmentation from volumetric medical images is becoming an essential pre-step in aiding the diagnosis, guiding the therapy, and patient management for vascular-related diseases. Deep learning-based methods have drawn many attentions, but most of them did not fully utilize the multi-scale spatial information of vessels. To address this shortcoming, we propose a multi-scale network similar to the well-known multi-scale DeepMedic. It also includes a double-pathway architecture and a class-balanced loss at the voxel level (MDNet-Vb) to achieve both the computation efficiency and segmentation accuracy. Methods: The proposed network consists two parallel pathways to learn the multi-scale vessel morphology. Specifically, the pathway with a normal resolution uses three-dimensional (3D) U-Net fed with small inputs to learn the local details with relatively small storage and time consumption. The pathway with a low-resolution employs 3D fully convolutional network (FCN) fed with downsampled large inputs to learn the overall spatial relationships between vessels and adjacent tissues, and the morphological information of large vessels. To cope with the class-imbalanced issue in vessel segmentation, we propose a class-balanced loss at the voxel level with uniform sampling strategy. The class-balanced loss at the voxel level re-balances the loss function with a coefficient that is inversely proportional to the normalized effective number at the voxel level of each class. The uniform sampling strategy extracts training data by sampling uniformly from two classes in every epoch. Results: Our MDNet-Vb outperforms several state-of-the-art methods including ResNet, DenseNet, 3D U-Net, V-Net, and DeepMedic with the highest dice coefficients of 72.91% and 69.32% on cardiac computed tomography angiography (CTA) dataset and cerebral magnetic resonance angiography (MRA) dataset, respectively. Among four different double-pathway networks, our network (3D U-Net+3D FCN) not only has the fewest training parameters and shortest training time, but also gets competitive dice coefficients on both the CTA and MRA datasets. Compared with classical losses, our class-balanced focal loss (FL-Vb) and dice coefficient loss at the voxel level (Dsc-Vb) alleviates class imbalanced issue by improving both the sensitivity and dice coefficient on the CTA and MRA datasets. Moreover, simultaneously training on two datasets shows that our method has the highest dice coefficient of 73.06% and 65.40% on CTA and MRA datasets, respectively, outperforming the commonly used methods, such as U-Net and DeepMedic, which demonstrates the generalization potential of our network for segmenting different blood vessels. Conclusions: Our MDNet-Vb method demonstrates its superiority over other state-of-the-art methods, on both cardiac CTA and cerebral MRA datasets. For the network architecture, the MDNet-Vb combined the 3D U-Net and 3D FCN, which dramatically reduces the network parameters yet maintains the segmentation accuracy. The class-balanced loss at the voxel level further improves accuracy by properly alleviating the class-imbalanced issue between different classes. In summary, MDNet-Vb is promising for vessel segmentation from various volumetric medical images.

DDNet: A Novel Network for Cerebral Artery Segmentation from MRA Images

Fully Automatic Deep Learning Trained on Limited Data for Carotid Artery Segmentation from Large Image Volumes

Generative Adversarial Network Based Cerebrovascular Segmentation for Time-of-flight Magnetic Resonance Angiography Image

SS-Net: 3D Spatial-Spectral Network for Cerebrovascular Segmentation in TOF-MRA

Cerebrovascular Segmentation from TOF-MRA Using Model- and Data-Driven Method Via Sparse Labels

Unsupervised Cerebrovascular Segmentation of TOF-MRA Images Based on Deep Neural Network and Hidden Markov Random Field Model

A Neural Network Approach to Segment Brain Blood Vessels in Digital Subtraction Angiography

CV-Attention UNet: Attention-based UNet for 3D Cerebrovascular Segmentation of Enhanced TOF-MRA Images

Automatic Cerebral Vessel Extraction in TOF-MRA Using Deep Learning

An Automatic Segmentation Method of Cerebral Arterial Tree in TOF-MRA Based on DBCNet

Vessel segmentation from volumetric images: a multi-scale double-pathway network with class-balanced loss at the voxel level

ERNet: Edge Regularization Network for Cerebral Vessel Segmentation in Digital Subtraction Angiography Images

A U-Net Deep Learning Framework for High Performance Vessel Segmentation in Patients With Cerebrovascular Disease

Retinal Vessels Segmentation Based on Dilated Multi-Scale Convolutional Neural Network

SDDC-Net: A U-shaped deep spiking neural P convolutional network for retinal vessel segmentation

Dual-path multi-scale context dense aggregation network for retinal vessel segmentation

Convolutional Neural Network with Asymmetric Encoding and Decoding Structure for Brain Vessel Segmentation on Computed Tomographic Angiography.

BRAVE-NET: Fully Automated Arterial Brain Vessel Segmentation in Patients With Cerebrovascular Disease

Automated Cerebrovascular Segmentation and Visualization of Intracranial Time-of-Flight Magnetic Resonance Angiography Based on Deep Learning

Attention convolutional neural network for accurate segmentation and quantification of lesions in ischemic stroke disease.

Cerebrovascular Segmentation from TOF-MRA Based on Multiple-U-net with Focal Loss Function.