Abstract:PurposeEarly detection of carotid atherosclerosis on the vessel wall (VW) magnetic resonance imaging (MRI) (VW‐MRI) images can prevent the progression of cardiovascular disease. However, the manual inspection process of the VW‐MRI images is cumbersome and has low reproducibility. Therefore in this paper, by using the convolutional neural networks (CNNs), we develop a deep morphology aided diagnosis (DeepMAD) network for automated segmentation of the VW of carotid artery and for automated diagnosis of the carotid atherosclerosis with the black‐blood (BB) VW‐MRI (i.e., the T1‐weighted MRI) in a slice‐by‐slice manner.MethodsThe proposed DeepMAD network consists of a segmentation subnetwork and a diagnosis subnetwork for performing the segmentation and diagnosis tasks on the BB‐VW‐MRI images, where the manual labeled lumen area, the manual labeled outer wall area and the manual labeled lesion Types based on the modified American Heart Association (AHA) criteria are used as the ground‐truth. Specifically, a deep U‐shape CNN with a weighted fusion layer is designed as the segmentation subnetwork, where the lumen area and the outer wall area can be simultaneously segmented under the supervision of the triple Dice loss to provide the vessel wall map as morphological information. Then, the image stream from the BB‐VWMRI image and the morphology stream from the obtained vessel wall map are extracted from two deep CNNs and combined to obtain the diagnosis results of atherosclerosis in the diagnosis subnetwork. In addition, the triple input set is formed by three carotid regions of interest (ROIs) from three consecutive slices of the MRI sequence and input to the DeepMAD network, where the first and last slices used as additional adjacent slices to provide 2.5D spatial information along the carotid artery centerline for the intermediate slice, which is the target slice for segmentation and diagnosis in the study.ResultsCompared to other existing methods, the DeepMAD network can achieve promising segmentation performances (0.9594 Dice for the lumen and 0.9657 Dice for the outer wall) and better diagnosis Accuracy of the carotid atherosclerosis (0.9503 AUC and 0.8916 Accuracy) in the test dataset (including invisible subjects) from same source as the training dataset. In addition, the trained DeepMAD model can be successfully transferred to another test dataset for segmentation and diagnosis tasks with remarkable performance (0.9475 Dice for the lumen and 0.9542 Dice for the outer wall, 0. 9227 AUC and 0.8679 Accuracy for diagnosis).ConclusionsEven without the intervention of reviewers required for previous works, the proposed DeepMAD network automatically segments the lumen and the outer wall together and diagnoses the carotid atherosclerosis with high performances. The DeepMAD network can be used in clinical trials to help radiologists get rid of tedious reading tasks, such as screening review to separate the normal carotid from the atherosclerotic arteries and outlining the vessel wall contours.

GAPNet: Granularity Attention Network with Anatomy-Prior-Constraint for Carotid Artery Segmentation

Fully Automatic Deep Learning Trained on Limited Data for Carotid Artery Segmentation from Large Image Volumes

Generative Adversarial Network Based Cerebrovascular Segmentation for Time-of-flight Magnetic Resonance Angiography Image

AwCPM-Net: A Collaborative Constraint GAN for 3D Coronary Artery Reconstruction in Intravascular Ultrasound Sequences.

PSAA-nnUNet: An Efficient Method for CT Carotid Artery Image Segmentation

Segmentation of carotid artery vessel wall and diagnosis of carotid atherosclerosis on black blood magnetic resonance imaging with multi‐task learning

Carotid Vessel Wall Segmentation Through Domain Aligner, Topological Learning, and Segment Anything Model for Sparse Annotation in MR Images

3D Pyramidal Densely Connected Network with Cross-Frame Uncertainty Guidance for Intravascular Ultrasound Sequence Segmentation.

AGFA-Net: Attention-Guided and Feature-Aggregated Network for Coronary Artery Segmentation using Computed Tomography Angiography

A 3D framework for segmentation of carotid artery vessel wall and identification of plaque compositions in multi-sequence MR images

The study on the segmentation of carotid vessel wall in multicontrast MR images based on U?Net neural network

DDNet: A Novel Network for Cerebral Artery Segmentation from MRA Images

Anatomy Prior Based U-net for Pathology Segmentation with Attention

Complex Carotid Artery Segmentation in Multi-Contrast MR Sequences by Improved Optimal Surface Graph Cuts Based on Flow Line Learning

Deep Morphology Aided Diagnosis Network for Segmentation of Carotid Artery Vessel Wall and Diagnosis of Carotid Atherosclerosis on Black‐blood Vessel Wall MRI

Carotid artery wall segmentation in ultrasound image sequences using a deep convolutional neural network

Segmentation of carotid vessel wall using U-Net and segmentation average network

Deep Learning-Based Carotid Artery Vessel Wall Segmentation in Black-Blood MRI Using Anatomical Priors

Automated Artery Localization and Vessel Wall Segmentation of Magnetic Resonance Vessel Wall Images using Tracklet Refinement and Polar Conversion

Contour attention network for cerebrovascular segmentation from TOF‐MRA volumetric images

Segmentation and Vascular Vectorization for Coronary Artery by Geometry-based Cascaded Neural Network