Abstract:PurposeEarly detection of carotid atherosclerosis on the vessel wall (VW) magnetic resonance imaging (MRI) (VW‐MRI) images can prevent the progression of cardiovascular disease. However, the manual inspection process of the VW‐MRI images is cumbersome and has low reproducibility. Therefore in this paper, by using the convolutional neural networks (CNNs), we develop a deep morphology aided diagnosis (DeepMAD) network for automated segmentation of the VW of carotid artery and for automated diagnosis of the carotid atherosclerosis with the black‐blood (BB) VW‐MRI (i.e., the T1‐weighted MRI) in a slice‐by‐slice manner.MethodsThe proposed DeepMAD network consists of a segmentation subnetwork and a diagnosis subnetwork for performing the segmentation and diagnosis tasks on the BB‐VW‐MRI images, where the manual labeled lumen area, the manual labeled outer wall area and the manual labeled lesion Types based on the modified American Heart Association (AHA) criteria are used as the ground‐truth. Specifically, a deep U‐shape CNN with a weighted fusion layer is designed as the segmentation subnetwork, where the lumen area and the outer wall area can be simultaneously segmented under the supervision of the triple Dice loss to provide the vessel wall map as morphological information. Then, the image stream from the BB‐VWMRI image and the morphology stream from the obtained vessel wall map are extracted from two deep CNNs and combined to obtain the diagnosis results of atherosclerosis in the diagnosis subnetwork. In addition, the triple input set is formed by three carotid regions of interest (ROIs) from three consecutive slices of the MRI sequence and input to the DeepMAD network, where the first and last slices used as additional adjacent slices to provide 2.5D spatial information along the carotid artery centerline for the intermediate slice, which is the target slice for segmentation and diagnosis in the study.ResultsCompared to other existing methods, the DeepMAD network can achieve promising segmentation performances (0.9594 Dice for the lumen and 0.9657 Dice for the outer wall) and better diagnosis Accuracy of the carotid atherosclerosis (0.9503 AUC and 0.8916 Accuracy) in the test dataset (including invisible subjects) from same source as the training dataset. In addition, the trained DeepMAD model can be successfully transferred to another test dataset for segmentation and diagnosis tasks with remarkable performance (0.9475 Dice for the lumen and 0.9542 Dice for the outer wall, 0. 9227 AUC and 0.8679 Accuracy for diagnosis).ConclusionsEven without the intervention of reviewers required for previous works, the proposed DeepMAD network automatically segments the lumen and the outer wall together and diagnoses the carotid atherosclerosis with high performances. The DeepMAD network can be used in clinical trials to help radiologists get rid of tedious reading tasks, such as screening review to separate the normal carotid from the atherosclerotic arteries and outlining the vessel wall contours.

Deep Morphology Aided Diagnosis Network for Segmentation of Carotid Artery Vessel Wall and Diagnosis of Carotid Atherosclerosis on Black‐blood Vessel Wall MRI

Fully Automatic Deep Learning Trained on Limited Data for Carotid Artery Segmentation from Large Image Volumes

Segmentation of carotid artery vessel wall and diagnosis of carotid atherosclerosis on black blood magnetic resonance imaging with multi‐task learning

Deep Learning-Based Carotid Artery Vessel Wall Segmentation in Black-Blood MRI Using Anatomical Priors

Deep Learning-Based Automated Detection of Arterial Vessel Wall and Plaque on Magnetic Resonance Vessel Wall Images

Automated Morphologic Analysis of Intracranial and Extracranial Arteries Using Convolutional Neural Networks

Automatic Segmentation of Carotid Vessel Wall Using Convolutional Neural Network

A 3D framework for segmentation of carotid artery vessel wall and identification of plaque compositions in multi-sequence MR images

Multi-Task Deep Convolutional Neural Network for the Segmentation of Type B Aortic Dissection

Deep Learning-Based Carotid Media-Adventitia and Lumen-Intima Boundary Segmentation from Three-Dimensional Ultrasound Images

Detection of Carotid Arteries in Magnetic Resonance Imaging Based on Deep Learning

Carotid atherosclerotic plaque segmentation in multi-weighted MRI using a two-stage neural network: advantages of training with high-resolution imaging and histology

A Neural Network Approach to Segment Brain Blood Vessels in Digital Subtraction Angiography

MT-NeT: Multi-Modality Transfer Learning Network for Automated Carotid Vessel Wall Segmentation Using Sparse Annotation in MRI.

Carotid artery wall segmentation in ultrasound image sequences using a deep convolutional neural network

756 A 3D Deep-learning Based Algorithm for Cerebral Vessel and Aneurysm Segmentation From CTA Images

A Three-Dimensional Deep Convolutional Neural Network for Automatic Segmentation and Diameter Measurement of Type B Aortic Dissection

Complex Carotid Artery Segmentation in Multi-Contrast MR Sequences by Improved Optimal Surface Graph Cuts Based on Flow Line Learning

Evaluating a 3D deep learning pipeline for cerebral vessel and intracranial aneurysm segmentation from computed tomography angiography-digital subtraction angiography image pairs.

Automated Artery Localization and Vessel Wall Segmentation of Magnetic Resonance Vessel Wall Images using Tracklet Refinement and Polar Conversion

Automated Cerebrovascular Segmentation and Visualization of Intracranial Time-of-Flight Magnetic Resonance Angiography Based on Deep Learning