Abstract:Background Atherosclerotic cardiovascular disease is the leading cause of death worldwide. Early detection of carotid atherosclerosis can prevent the progression of cardiovascular disease. Many (semi‐) automatic methods have been designed for the segmentation of carotid vessel wall and the diagnosis of carotid atherosclerosis (i.e., the lumen segmentation, the outer wall segmentation, and the carotid atherosclerosis diagnosis) on black blood magnetic resonance imaging (BB‐MRI). However, most of these methods ignore the intrinsic correlation among different tasks on BB‐MRI, leading to limited performance. Purpose Thus, we model the intrinsic correlation among the lumen segmentation, the outer wall segmentation, and the carotid atherosclerosis diagnosis tasks on BB‐MRI by using the multi‐task learning technique and propose a gated multi‐task network (GMT‐Net) to perform three related tasks in a neural network (i.e., carotid artery lumen segmentation, outer wall segmentation, and carotid atherosclerosis diagnosis). Methods In the proposed method, the GMT‐Net is composed of three modules, including the sharing module, the segmentation module, and the diagnosis module, which interact with each other to achieve better learning performance. At the same time, two new adaptive layers, namely, the gated exchange layer and the gated fusion layer, are presented to exchange and merge branch features. Results The proposed method is applied to the CAREII dataset (i.e., 1057 scans) for the lumen segmentation, the outer wall segmentation, and the carotid atherosclerosis diagnosis. The proposed method can achieve promising segmentation performances (0.9677 Dice for the lumen and 0.9669 Dice for the outer wall) and better diagnosis accuracy of carotid atherosclerosis (0.9516 AUC and 0.9024 Accuracy) in the "CAREII test" dataset (i.e., 106 scans). The results show that the proposed method has statistically significant accuracy and efficiency. Conclusions Even without the intervention of reviewers required for the previous works, the proposed method automatically segments the lumen and outer wall together and diagnoses carotid atherosclerosis with high performance. The proposed method can be used in clinical trials to help radiologists get rid of tedious reading tasks, such as screening review to separate normal carotid arteries from atherosclerotic arteries and to outline vessel wall contours.

Multi-task learning with Multi-view Weighted Fusion Attention for artery-specific calcification analysis

Magnetic Resonance Multitasking for Multidimensional Assessment of Cardiovascular System: Development and Feasibility Study on the Thoracic Aorta

Spatio-temporal Multi-Task Network Cascade for Accurate Assessment of Cardiac CT Perfusion.

Active multitask learning with uncertainty-weighted loss for coronary calcium scoring

Automated segment-level coronary artery calcium scoring on non-contrast CT: a multi-task deep-learning approach

Fully automatic framework for comprehensive coronary artery calcium scores analysis on non-contrast cardiac-gated CT scan: Total and vessel-specific quantifications

Multiview Two-Task Recursive Attention Model for Left Atrium and Atrial Scars Segmentation

Edge-aware Multi-task Network for Integrating Quantification Segmentation and Uncertainty Prediction of Liver Tumor on Multi-modality Non-contrast MRI

Multi-Source and Multi-Sequence Myocardial Pathology Segmentation Using a Cascading Refinement CNN

Efficient Multi-View Fusion and Flexible Adaptation to View Missing in Cardiovascular System Signals

Multitask Learning for Improved Late Mechanical Activation Detection of Heart from Cine DENSE MRI

Segment aorta and localize landmarks simultaneously on noncontrast CT using a multitask learning framework for patients without severe vascular disease

Superficial femoral artery calcification segmentation and detection in CT angiography using convolutional neural network

Segmentation of carotid artery vessel wall and diagnosis of carotid atherosclerosis on black blood magnetic resonance imaging with multi‐task learning

Automatic segmentation of intraluminal thrombosis of abdominal aortic aneurysms from CT angiography using a mixed-scale-driven multiview perception network (M2Net) model

Regional perception and multi-scale feature fusion network for cardiac segmentation

Automated Multi-Channel Segmentation for the 4D Myocardial Velocity Mapping Cardiac MR

Coronary Calcium Detection using 3D Attention Identical Dual Deep Network Based on Weakly Supervised Learning

Coronary artery segmentation in CCTA images based on multi-scale feature learning

Deep anatomy learning for lung airway and artery-vein modeling with contrast-enhanced CT synthesis

Multimodal Learning To Improve Cardiac Late Mechanical Activation Detection From Cine MR Images