Abstract:Background: The role of next generation sequencing (NGS) for identifying high risk mutations in thyroid nodules following fine needle aspiration (FNA) biopsy continues to grow. However, ultrasound diagnosis even using the American College of Radiology's Thyroid Imaging Reporting and Data System (TI-RADS) has limited ability to stratify genetic risk. The purpose of this study was to incorporate an artificial intelligence (AI) algorithm of thyroid ultrasound with object detection within the TI-RADS scoring system to improve prediction of genetic risk in these nodules.Methods: Two hundred fifty-two nodules from 249 patients that underwent ultrasound imaging and ultrasound-guided FNA with NGS with or without resection were retrospectively selected for this study. A machine learning program (Google AutoML) was employed for both automated nodule identification and risk stratification. Two hundred one nodules were used for model training and 51 reserved for testing. Three blinded radiologists scored the images of the test set nodules using TI-RADS and assigned each nodule as high or low risk based on the presence of highly suspicious imaging features on TI-RADS (very hypoechoic, taller-than-wide, extra-thyroidal extension, punctate echogenic foci). Subsequently, the TI-RADS classification was modified to incorporate AI for T4 nodules while treating T1-3 as low risk and T5 as high risk. All diagnostic predictions were compared to the presence of a high-risk mutation and pathology when available.Results: The AI algorithm correctly located all nodules in the test dataset (100% object detection). The model predicted the malignancy risk with a sensitivity of 73.9%, specificity of 70.8%, positive predictive value (PPV) of 70.8%, negative predictive value (NPV) of 73.9% and accuracy of 72.4% during the testing. The radiologists performed with a sensitivity of 52.1 ± 4.4%, specificity of 65.2 ± 6.4%, PPV of 59.1 ± 3.5%, NPV of 58.7 ± 1.8%, and accuracy of 58.8 ± 2.5% when using TI-RADS and sensitivity of 53.6 ± 17.6% (p=0.87), specificity of 83.3 ± 7.2% (p=0.06), PPV of 75.7 ± 8.5% (p=0.13), NPV of 66.0 ± 8.8% (p=0.31), and accuracy of 68.7 ± 7.4% (p=0.21) when using AI-modified TI-RADS.Conclusions: Incorporation of AI into TI-RADS improved radiologist performance and showed better malignancy risk prediction than AI alone when classifying thyroid nodules. Employing AI in existing thyroid nodule classification systems may help more accurately identifying high-risk nodules.

Simplifying risk stratification for thyroid nodules on ultrasound: validation and performance of an artificial intelligence thyroid imaging reporting and data system

Comparison of diagnostic accuracy and utility of artificial intelligence–optimized ACR TI-RADS and original ACR TI-RADS: a multi-center validation study based on 2061 thyroid nodules

Assessment of the Diagnostic Performance of a Commercially Available Artificial Intelligence Algorithm for Risk Stratification of Thyroid Nodules on Ultrasound

ACR TI-RADS and ATA ultrasound classifications are helpful for the management of thyroid nodules located in the isthmus

Modified ACR TI-RADS and Modified AI TI-RADS for Thyroid Nodules: A Multicenter Retrospective Study

Revised Thyroid Imaging Reporting and Data System (TIRADS): imitating the American College of Radiology TIRADS, a single-center retrospective study

Incorporation of a Machine Learning Algorithm With Object Detection Within the Thyroid Imaging Reporting and Data System Improves the Diagnosis of Genetic Risk

A Single-Center Retrospective Validation Study of the American College of Radiology Thyroid Imaging Reporting and Data System.

Combining Image similarity and Predictive AI Models to Decrease Subjectivity in Thyroid Nodule Diagnosis and Improve Malignancy Prediction

Value of Artificial Intelligence in Improving the Accuracy of Diagnosing TI-RADS Category 4 Nodules

Clinical evaluation of an Artificial Intelligence–based decision support system for the diagnosis and ACR TI-RADS classification of thyroid nodules

Classifying thyroid nodules with the American College of Radiology Thyroid Imaging Reporting and Data System: A simple and cost-effective approach for assessing malignancy risk

Avoidable biopsies? Validating artificial intelligence-based decision support software in indeterminate thyroid nodules

Does a Higher American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI‐RADS) Score Forecast an Increased Risk of Malignancy? A Correlation Study of ACR TI‐RADS with FNA Cytology in the Evaluation of Thyroid Nodules

Improving the Efficacy of ACR TI-RADS Through Deep Learning-Based Descriptor Augmentation

The Diagnostic Value of Artificial Intelligence Ultrasound S-Detect Technology for Thyroid Nodules

Comparative Analysis of AI-SONICTM Thyroid System and Six Thyroid Risk Stratification Guidelines in Papillary Thyroid Cancer: A Retrospective Cohort Study

A new thyroid imaging reporting and data system for nodules: Based on grayscale and color Doppler ultrasonography

Diagnostic efficiency among Eu-/C-/ACR-TIRADS and S-Detect for thyroid nodules: a systematic review and network meta-analysis

A comparison between ACR TI-RADS and artificial intelligence TI-RADS regarding to diagnostic efficacy and ability to reduce unnecessary fine-needle aspiration cytology

Diagnostic Value of Artificial Intelligence‐Assistant Diagnostic System Combined With Contrast‐Enhanced Ultrasound in Thyroid TI‐RADS 4 Nodules