Abstract:Background: Thyroid nodules are commonly identified through ultrasound imaging, which plays a crucial role in the early detection of malignancy. The diagnostic accuracy, however, is significantly influenced by the expertise of radiologists, the quality of equipment, and image acquisition techniques. This variability underscores the critical need for computational tools that support diagnosis. Methods: This retrospective study evaluates an artificial intelligence (AI)-driven system for thyroid nodule assessment, integrating clinical practices from multiple prominent Thai medical centers. We included patients who underwent thyroid ultrasonography complemented by ultrasound-guided fine needle aspiration (FNA) between January 2015 and March 2021. Participants formed a consecutive series, enhancing the study's validity. A comparative analysis was conducted between the AI model's diagnostic performance and that of both an experienced radiologist and a third-year radiology resident, using a dataset of 600 ultrasound images from three distinguished Thai medical institutions, each verified with cytological findings. Results: The AI system demonstrated superior diagnostic performance, with an overall sensitivity of 80% [95% confidence interval (CI): 59.3-93.2%] and specificity of 71.4% (95% CI: 53.7-85.4%). At Siriraj Hospital, the AI achieved a sensitivity of 90.0% (95% CI: 55.5-99.8%), specificity of 100.0% (95% CI: 69.2-100%), positive prediction value (PPV) of 100.0%, negative prediction value (NPV) of 90.9%, and an overall accuracy of 95.0%, indicating the benefits of AI's extensive training across diverse datasets. The experienced radiologist's sensitivity was 40.0% (95% CI: 21.1-61.3%), while the specificity was 80.0% (95% CIs: 63.6-91.6%), respectively, showing that the AI significantly outperformed the radiologist in terms of sensitivity (P=0.043) while maintaining comparable specificity. The inter-observer variability analysis indicated a moderate agreement (K=0.53) between the radiologist and the resident, contrasting with fair agreement (K=0.37/0.33) when each was compared with the AI system. Notably, 95% CIs for these diagnostic indexes highlight the AI system's consistent performance across different settings. Conclusions: The findings advocate for the integration of AI into clinical settings to enhance the diagnostic accuracy of radiologists in assessing thyroid nodules. The AI system, designed as a supportive tool rather than a replacement, promises to revolutionize thyroid nodule diagnosis and management by providing a high level of diagnostic precision.

The Use of Artificial Intelligence in the Diagnosis and Classification of Thyroid Nodules: An Update

The Application of Artificial Intelligence in Thyroid Nodules: A Systematic Review Based on Bibliometric Analysis

Artificial intelligence in the diagnosis of thyroid cancer: Recent advances and future directions

From Bench-to-Bedside: How Artificial Intelligence Is Changing Thyroid Nodule Diagnostics

A Systematic Review on the Role of Artificial Intelligence in Sonographic Diagnosis of Thyroid Cancer: Past, Present and Future

Artificial intelligence in thyroid ultrasound

AI in Thyroid Cancer Diagnosis: Techniques, Trends, and Future Directions

Diagnostic performance of artificial intelligence in interpreting thyroid nodules on ultrasound images: a multicenter retrospective study

Update on thyroid ultrasound: a narrative review from diagnostic criteria to artificial intelligence techniques

Artificial intelligence assisted diagnosis of early tc markers and its application

Automatic detection of thyroid nodules with a real-time artificial intelligence system in a real clinical scenario and the associated influencing factors

Artificial Intelligence in Thyroid Field—A Comprehensive Review

Machine Learning and Artificial Intelligence in Thyroid Cancer Screening and Diagnosis: A Comprehensive Systematic Review

The Diagnostic Value of Artificial Intelligence Ultrasound S-Detect Technology for Thyroid Nodules

Artificial Intelligence for Personalized Medicine in Thyroid Cancer: Current Status and Future Perspectives

Incorporation of a Machine Learning Algorithm With Object Detection Within the Thyroid Imaging Reporting and Data System Improves the Diagnosis of Genetic Risk

Advancements in Radiomics and Artificial Intelligence for Thyroid Cancer Diagnosis

A Comparison of the Performances of Artificial Intelligence System and Radiologists in the Ultrasound Diagnosis of Thyroid Nodules

The clinical value of artificial intelligence in assisting junior radiologists in thyroid ultrasound: a multicenter prospective study from real clinical practice

Application Of Artificial Intelligence In The Diagnosis Of Thyroid Cancer With Enhanced Computed Tomography

Integrated Diagnostics of Thyroid Nodules