Abstract:Background Breast tumor is a fatal threat to the health of women. Ultrasound (US) is a common and economical method for the diagnosis of breast cancer. Breast imaging reporting and data system (BI‐RADS) category 4 has the highest false‐positive value of about 30% among five categories. The classification task in BI‐RADS category 4 is challenging and has not been fully studied. Purpose This work aimed to use convolutional neural networks (CNNs) for breast tumor classification using B‐mode images in category 4 to overcome the dependence on operator and artifacts. Additionally, this work intends to take full advantage of morphological and textural features in breast tumor US images to improve classification accuracy. Methods First, original US images coming directly from the hospital were cropped and resized. In 1385 B‐mode US BI‐RADS category 4 images, the biopsy eliminated 503 samples of benign tumor and left 882 of malignant. Then, K‐means clustering algorithm and entropy of sliding windows of US images were conducted. Considering the diversity of different characteristic information of malignant and benign represented by original B‐mode images, K‐means clustering images and entropy images, they are fused in a three‐channel form multi‐feature fusion images dataset. The training, validation, and test sets are 969, 277, and 139. With transfer learning, 11 CNN models including DenseNet and ResNet were investigated. Finally, by comparing accuracy, precision, recall, F1‐score, and area under curve (AUC) of the results, models which had better performance were selected. The normality of data was assessed by Shapiro‐Wilk test. DeLong test and independent t‐test were used to evaluate the significant difference of AUC and other values. False discovery rate was utilized to ultimately evaluate the advantages of CNN with highest evaluation metrics. In addition, the study of anti‐log compression was conducted but no improvement has shown in CNNs classification results. Results With multi‐feature fusion images, DenseNet121 has highest accuracy of 80.22 ± 1.45% compared to other CNNs, precision of 77.97 ± 2.89% and AUC of 0.82 ± 0.01. Multi‐feature fusion improved accuracy of DenseNet121 by 1.87% from classification of original B‐mode images (p

Multi-modality Relation Attention Network for Breast Tumor Classification

Breast Tumor Classification based on MRI-US Images by Disentangling Modality Features

Multi-modal Fusion Network with Intra- and Inter-Modality Attention for Prognosis Prediction in Breast Cancer

MDAA: multi-scale and dual-adaptive attention network for breast cancer classification

Richer fusion network for breast cancer classification based on multimodal data

Classification of Breast Mass in 3D Ultrasound Images with Annotations Based on Convolutional Neural Networks

MDFF-Net: A multi-dimensional feature fusion network for breast histopathology image classification

An Attentive Multi-Modal CNN for Brain Tumor Radiogenomic Classification

Attention Model Enhancement Network for Breast Tumor Classification

Deep learning‐based multimodal fusion network for segmentation and classification of breast cancers using B‐mode and elastography ultrasound images

Auto-weighting for Breast Cancer Classification in Multimodal Ultrasound

MAL: Multi-modal Attention Learning for Tumor Diagnosis Based on Bipartite Graph and Multiple Branches

Breast Tumor Classification in Ultrasound Images by Fusion of Deep Convolutional Neural Network and Shallow LBP Feature

Classification of multi‐feature fusion ultrasound images of breast tumor within category 4 using convolutional neural networks

Attention Model Enhanced Network for Classification of Breast Cancer Image

Contextual Features and Information Bottleneck-Based Multi-Input Network for Breast Cancer Classification from Contrast-Enhanced Spectral Mammography

Multi-path synergic fusion deep neural network framework for breast mass classification using digital breast tomosynthesis

3MT-Net: A Multi-modal Multi-task Model for Breast Cancer and Pathological Subtype Classification Based on a Multicenter Study

Multimodal Fusion Learning with Dual Attention for Medical Imaging

Study on the classification of benign and malignant breast lesions using a multi-sequence breast MRI fusion radiomics and deep learning model

MFU-Net: a deep multimodal fusion network for breast cancer segmentation with dual-layer spectral detector CT