Abstract:Background Deep learning (DL) algorithms are gaining extensive attention for their excellent performance in image recognition tasks. DL models can automatically make a quantitative assessment of complex medical image characteristics and achieve increased accuracy in diagnosis with higher efficiency. Purpose To determine the feasibility of using a DL approach to predict clinically negative axillary lymph node metastasis from US images in patients with primary breast cancer. Materials and Methods A data set of US images in patients with primary breast cancer with clinically negative axillary lymph nodes from Tongji Hospital (974 imaging studies from 2016 to 2018, 756 patients) and an independent test set from Hubei Cancer Hospital (81 imaging studies from 2018 to 2019, 78 patients) were collected. Axillary lymph node status was confirmed with pathologic examination. Three different convolutional neural networks (CNNs) of Inception V3, Inception-ResNet V2, and ResNet-101 architectures were trained on 90% of the Tongji Hospital data set and tested on the remaining 10%, as well as on the independent test set. The performance of the models was compared with that of five radiologists. The models' performance was analyzed in terms of accuracy, sensitivity, specificity, receiver operating characteristic curves, areas under the receiver operating characteristic curve (AUCs), and heat maps. Results The best-performing CNN model, Inception V3, achieved an AUC of 0.89 (95% confidence interval [CI]: 0.83, 0.95) in the prediction of the final clinical diagnosis of axillary lymph node metastasis in the independent test set. The model achieved 85% sensitivity (35 of 41 images; 95% CI: 70%, 94%) and 73% specificity (29 of 40 images; 95% CI: 56%, 85%), and the radiologists achieved 73% sensitivity (30 of 41 images; 95% CI: 57%, 85%; P = .17) and 63% specificity (25 of 40 images; 95% CI: 46%, 77%; P = .34). Conclusion Using US images from patients with primary breast cancer, deep learning models can effectively predict clinically negative axillary lymph node metastasis. Artificial intelligence may provide an early diagnostic strategy for lymph node metastasis in patients with breast cancer with clinically negative lymph nodes. Published under a CC BY 4.0 license. Online supplemental material is available for this article. See also the editorial by Bae in this issue.

Comparative Study of Deep Learning Models for Automatic Detection of Metastases in H&E Stained Images

Deep learning system for lymph node quantification and metastatic cancer identification from whole-slide pathology images

Deep Learning Provides Rapid Screen for Breast Cancer Metastasis with Sentinel Lymph Nodes

Identifying Metastases in Sentinel Lymph Nodes with Deep Convolutional Neural Networks

Se-DenseNet - Attention-Based Network for Detecting Pathological Images of Metastatic Breast Cancer.

Metastatic Cancer Image Classification Based On Deep Learning Method

Metastatic Breast Cancer Recognition in Histopathology Images Using Convolutional Neural Network with Attention Mechanism

Lymph Node Metastasis Prediction from Primary Breast Cancer US Images Using Deep Learning

Impact of Deep Learning Assistance on the Histopathologic Review of Lymph Nodes for Metastatic Breast Cancer

Deep Learning Prediction of Axillary Lymph Node Metastasis in Breast Cancer Patients Using Clinical Implication-Applied Preprocessed CT Images

Deep Learning for Identifying Metastatic Breast Cancer

Diagnosis of Lymph Node Metastasis in Head and Neck Squamous Cell Carcinoma Using Deep Learning

Evaluation of a Deep Learning Model for Metastatic Squamous Cell Carcinoma Prediction From Whole Slide Images

A deep learning model for lymph node metastasis prediction based on digital histopathological images of primary endometrial cancer

Deep Learning-Based Histopathological Image Analysis for Automated Detection and Staging of Melanoma

Automated Diagnosis of Lymphoma with Digital Pathology Images Using Deep Learning

Large-Scale Deep Learning for Metastasis Detection in Pathology Reports

Classification and Detection of Cancer in Histopathologic Scans of Lymph Node Sections Using Convolutional Neural Network

A Study of Deep Learning Colon Cancer Detection in Limited Data Access Scenarios

HI-Net: A novel histopathologic image segmentation model for metastatic breast cancer via lightweight dataset construction

Deep neural network trained on gigapixel images improves lymph node metastasis detection in clinical settings