Abstract:Abstract Purpose To evaluate deep learning analysis of thyroid nodule ultrasound images as a rule-out test for thyroid malignancy. Methods Supervised deep learning (DL) classifier of thyroid nodules was trained on 32,545 thyroid US images from 621 nodules representing all major benign and malignant types of thyroid lesions and tested on an independent set of 145 nodules collected at a different healthcare system in the United States. The Big Transfer BiT-M ResNet-50×1 convolutional neural net architecture was modified to contain 3, 4, 6 and 3 PreActBottleneck units per block 1 through 4. Weights pretrained on the ImageNet-21k dataset were loaded and weights for blocks 3 and 4 were fine-tuned for the binary classification task of distinguishing benign and malignant thyroid nodules. Results The deep learning thyroid nodule classifier achieved an area under receiver operating characteristic curve (AUROC) of 0.889 on five-fold cross-validation. The AUROC improved when images were scaled by nodule size and six randomly selected cine clip frames were added to the training set per epoch. GradCAM class activation heatmaps revealed that microcalcifications and spongiform appearance were reliably recognized by the classifier as malignant and benign features, respectively. Spongiform nodules were found to be benign even when microcystic spaces constituted less than 50% of nodule volume. To investigate the clinical relevance of the benign vs. malignant classifier, the binary classification threshold for the probability of malignancy generated by model was set at 7% to achieve sensitivity and negative predictive value (NPV) comparable to that of the fine needle aspiration biopsy (FNA). At this threshold, cross-validated deep-learning model achieved a sensitivity of 90%, specificity of 63%, positive predictive value (PPV) of 46% and negative predictive value of 94%. When tested on an independent image set that includes 18 classic papillary thyroid cancers (PTC), 5 follicular variant PTC, 4 medullary thyroid cancers, 3 follicular thyroid cancers (FTC), and 1 Hurthle cell thyroid cancer, the DL classifier achieved AUROC of 0.88, sensitivity of 97%, specificity of 61%, PPV of 40% and NPV of 99%. A single minimally-invasive FTC that had no suspicious features on thyroid ultrasound was incorrectly classified as benign. Conclusions This study demonstrates that the ultrasound-based deep-learning classifier of thyroid nodules achieves sensitivity and negative predictive value comparable to that of thyroid fine needle aspiration (FNA). Clinicians may use this tool to augment clinical judgment when determining whether to perform FNA procedures. Presentation: Saturday, June 11, 2022 1:00 p.m. - 3:00 p.m., Saturday, June 11, 2022 1:06 p.m. - 1:11 p.m.

Research on Thyroid Cancer Detection and Classification Using Deep Learning over Ultrasound Images

Ultrasound Image Classification of Thyroid Nodules Based on Deep Learning

Deep Learning and Handcrafted Features for Thyroid Nodule Classification

Automatic Classification of Nodules from 2D Ultrasound Images Using Deep Learning Networks

Research on The Identification of Benign and Malignant Thyroid Nodule Ultrasound Images Based on Deep Learning Model

Deep learning for classification of thyroid nodules on ultrasound: validation on an independent dataset

Deep convolutional neural networks in thyroid disease detection: A multi-classification comparison by ultrasonography and computed tomography

Automatic Malignant Thyroid Nodule Recognition in Ultrasound Images based on Deep Learning

Automated Detection and Classification of Thyroid Nodules in Ultrasound Images Using Clinical-Knowledge-guided Convolutional Neural Networks

Thyroid ultrasound image classification using a convolutional neural network

A Multi-View Deep Learning Model for Thyroid Nodules Detection and Characterization in Ultrasound Imaging

Feed forward Neural Networks for Accurate Thyroid Detection in Healthcare

An Intelligent Platform for Ultrasound Diagnosis of Thyroid Nodules

Thyroid Nodule Classification in Ultrasound Images by Fine-Tuning Deep Convolutional Neural Network

Automated Segmentation of Thyroid Nodule, Gland, and Cystic Components From Ultrasound Images Using Deep Learning

Bilinear Pooling for Thyroid Nodule Classification in Ultrasound Imaging

Deep learning for thyroid nodule examination: a technical review

Thyroid Nodule Detection in Ultrasound Images with Convolutional Neural Networks

A Deep Learning Framework for the Characterization of Thyroid Nodules from Ultrasound Images Using Improved Inception Network and Multi-Level Transfer Learning

RF11 | PSAT234 Deep learning analysis of thyroid nodule ultrasound images has high sensitivity and negative predictive value to rule-out thyroid cancer

Thyroid Nodules Risk Stratification Through Deep Learning Based on Ultrasound Images