Abstract:BACKGROUND: Preoperative determination of breast cancer molecular subtypes facilitates individualized treatment plan-making and improves patient prognosis. We aimed to develop an assembled convolutional neural network (ACNN) model for the preoperative prediction of molecular subtypes using multimodal ultrasound (US) images.METHODS: This multicentre study prospectively evaluated a dataset of greyscale US, colour Doppler flow imaging (CDFI), and shear-wave elastography (SWE) images in 807 patients with 818 breast cancers from November 2016 to February 2021. The St. Gallen molecular subtypes of breast cancer were confirmed by postoperative immunohistochemical examination. The monomodal ACNN model based on greyscale US images, the dual-modal ACNN model based on greyscale US and CDFI images, and the multimodal ACNN model based on greyscale US and CDFI as well as SWE images were constructed in the training cohort. The performances of three ACNN models in predicting four- and five-classification molecular subtypes and identifying triple negative from non-triple negative subtypes were assessed and compared. The performance of the multimodal ACNN was also compared with preoperative core needle biopsy (CNB).FINDING: The performance of the multimodal ACNN model (macroaverage area under the curve [AUC]: 0.89-0.96) was superior to that of the dual-modal ACNN model (macroaverage AUC: 0.81-0.84) and the monomodal ACNN model (macroaverage AUC: 0.73-0.75) in predicting four-classification breast cancer molecular subtypes, which was also better than that of preoperative CNB (AUC: 0.89-0.99 vs. 0.67-0.82, p < 0.05). In addition, the multimodal ACNN model outperformed the other two ACNN models in predicting five-classification molecular subtypes (AUC: 0.87-0.94 vs. 0.78-0.81 vs. 0.71-0.78) and identifying triple negative from non-triple negative breast cancers (AUC: 0.934-0.970 vs. 0.688-0.830 vs. 0.536-0.650, p < 0.05). Moreover, the multimodal ACNN model obtained satisfactory prediction performance for both T1 and non-T1 lesions (AUC: 0.957-0.958 and 0.932-0.985).INTERPRETATION: The multimodal US-based ACNN model is a potential noninvasive decision-making method for the management of patients with breast cancer in clinical practice.FUNDING: This work was supported in part by the National Natural Science Foundation of China (Grants 81725008 and 81927801), Shanghai Municipal Health Commission (Grants 2019LJ21 and SHSLCZDZK03502), and the Science and Technology Commission of Shanghai Municipality (Grants 19441903200, 19DZ2251100, and 21Y11910800).

Noninvasive assessment of breast cancer molecular subtypes on multiparametric MRI using convolutional neural network with transfer learning

Prediction of breast cancer molecular subtypes on DCE-MRI using convolutional neural network with transfer learning between two centers

Preoperative Non-Invasive Prediction of Breast Cancer Molecular Subtypes with a Deep Convolutional Neural Network on Ultrasound Images

Prediction of breast cancer molecular subtypes using DCE-MRI based on CNNs combined with ensemble learning

Decoding the molecular subtypes of breast cancer seen on multimodal ultrasound images using an assembled convolutional neural network model: A prospective and multicentre study

Cross-attention multi-branch CNN using DCE-MRI to classify breast cancer molecular subtypes

A Deep Learning Model for Predicting Molecular Subtype of Breast Cancer by Fusing Multiple Sequences of DCE-MRI From Two Institutes

Assessing Breast Cancer Volume Alterations Post-Neoadjuvant Chemotherapy Through DenseNet-201 Deep Learning Analysis on DCE-MRI

Efficient estimation of pharmacokinetic parameters from breast dynamic contrast-enhanced MRI based on a convolutional neural network for predicting molecular subtypes

A Channel‐Dimensional Feature‐Reconstructed Deep Learning Model for Predicting Breast Cancer Molecular Subtypes on Overall b‐Value Diffusion‐Weighted MRI

A deep learning model based on dynamic contrast-enhanced magnetic resonance imaging enables accurate prediction of benign and malignant breast lessons

Discriminating between benign and malignant breast tumors using 3D convolutional neural network in dynamic contrast enhanced-MR images

Apparent Diffusion Coefficient-Based Convolutional Neural Network Model Can Be Better Than Sole Diffusion-Weighted Magnetic Resonance Imaging to Improve the Differentiation of Invasive Breast Cancer From Breast Ductal Carcinoma In Situ

Machine Learning-Based Analysis of MR Multiparametric Radiomics for the Subtype Classification of Breast Cancer.

A Convolutional Neural Network Based on Ultrasound Images of Primary Breast Masses: Prediction of Lymph-Node Metastasis in Collaboration with Classification of Benign and Malignant Tumors.

Prior to Initiation of Chemotherapy, Can We Predict Breast Tumor Response? Deep Learning Convolutional Neural Networks Approach Using a Breast MRI Tumor Dataset

Comparison of Dynamic Contrast‐Enhanced MRI and Non‐Mono‐Exponential Model‐Based Diffusion‐Weighted Imaging for the Prediction of Prognostic Biomarkers and Molecular Subtypes of Breast Cancer Based on Radiomics

Predicting Hormone Receptors and PAM50 Subtypes of Breast Cancer from Multi-Scale Lesion Images of DCE-MRI with Transfer Learning Technique

Study on the classification of benign and malignant breast lesions using a multi-sequence breast MRI fusion radiomics and deep learning model

Combined Diagnosis of Multiparametric MRI-based Deep Learning Models Facilitates Differentiating Triple-Negative Breast Cancer from Fibroadenoma Magnetic Resonance BI-RADS 4 Lesions

Raman spectroscopy combined with convolutional neural network for the sub-types classification of breast cancer and critical feature visualization