Abstract:PurposeThe ultrasound (US) diagnosis of breast cancer is usually based on a single-region of a whole breast tumor from a single ultrasonic modality, which limits the diagnostic performance. Multiple regions on multimodal US images of breast tumors may all have useful information for diagnosis. This study aimed to propose a multi-region radiomics approach with multimodal US for artificially intelligent diagnosis of malignant and benign breast tumors.Materials and methodsFirstly, radiomics features were extracted from five regions of interest (ROIs) on B-mode US and contrast-enhanced ultrasound (CEUS) images, including intensity statistics, gray-level co-occurrence matrix texture features and binary texture features. The multiple ROIs included the whole tumor region, strongest perfusion region, marginal region and surrounding region. Secondly, a deep neural network, composed of the point-wise gated Boltzmann machine and the restricted Boltzmann machine, was adopted to comprehensively learn and select features. Thirdly, the support vector machine was used for classification between benign and malignant breast tumors. Finally, five single-region classification models were generated from five ROIs, and they were fused to form an integrated classification model.ResultsExperimental evaluation was conducted on multimodal US images of breast from 187 patients with breast tumors (68 malignant and 119 benign). Under five-fold cross-validation, the classification accuracy, sensitivity, specificity, Youden's index and area under the receiver operating characteristic curve (AUC) with our model were 87.1% ± 3.3%, 77.4% ± 11.8%, 92.4% ± 7.2%, 69.8% ± 8.6% and 0.849 ± 0.043, respectively. Our model was significantly better than single-region single-modal methods in terms of the AUC and accuracy (p < 0.05).ConclusionIn addition to the whole tumor region, the other regions including the strongest perfusion region, marginal region and surrounding region on US images can assist breast cancer diagnosis. The multi-region multimodal radiomics model achieved the best classification results. Our artificially intelligent model would be potentially useful for clinical diagnosis of breast cancer.

Multi-Modal Features for Intelligent Differential Diagnosis of Solitary Pulmonary Tumors by Using Endobronchial Ultrasonography Images

Enhancing Pulmonary Tumor Diagnosis Based on Endobronchial Ultrasound Images Through Cross-Domain Features Via Supervised Contrastive Learning

A Hybrid CNN Feature Model for Pulmonary Nodule Malignancy Risk Differentiation.

Differentiation of Pulmonary Mucosa-Associated Lymphoid Tissue Lymphoma and Pulmonary Adenocarcinoma by Radiomics

Scoring model of convex probe endobronchial ultrasound multimodal imaging in differentiating benign and malignant lung lesions

The interpretation of endobronchial ultrasound image using 3D convolutional neural network for differentiating malignant and benign mediastinal lesions

Endobronchial Ultrasound-Based Support Vector Machine Model for Differentiating between Benign and Malignant Mediastinal and Hilar Lymph Nodes

Deep-Learning Model of ResNet Combined with CBAM for Malignant–Benign Pulmonary Nodules Classification on Computed Tomography Images

Feature Selection and Performance Evaluation of Support Vector Machine (Svm)-Based Classifier for Differentiating Benign and Malignant Pulmonary Nodules by Computed Tomography

Using Spatio-Temporal Dual-Stream Network with Self-Supervised Learning for Lung Tumor Classification on Radial Probe Endobronchial Ultrasound Video

A Novel Approach with Dual-Sampling Convolutional Neural Network for Ultrasound Image Classification of Breast Tumors

The Value of Radiomics Based on Dual-Energy CT for Differentiating Benign from Malignant Solitary Pulmonary Nodules.

Multi-region radiomics for artificially intelligent diagnosis of breast cancer using multimodal ultrasound

Multi-Features-Based Automated Breast Tumor Diagnosis Using Ultrasound Image and Support Vector Machine

Multi-Modal Feature Fusion-Based Multi-Branch Classification Network for Pulmonary Nodule Malignancy Suspiciousness Diagnosis

Optimized fuzzy K-nearest neighbor approach for accurate lung cancer prediction based on radial endobronchial ultrasonography

Differential Diagnosis of Pathological Type of Peripheral Lung Cancer with Multimodal Contrast-Enhanced Ultrasound

Dual-mode artificially-intelligent diagnosis of breast tumours in shear-wave elastography and B-mode ultrasound using deep polynomial networks.

TransEBUS: The interpretation of endobronchial ultrasound image using hybrid transformer for differentiating malignant and benign mediastinal lesions

Breast Tumor Classification in Ultrasound Images by Fusion of Deep Convolutional Neural Network and Shallow LBP Feature

Improved Lung Nodule Diagnosis Accuracy Using Lung CT Images with Uncertain Class