Abstract:Objective The aim of this study is to develop AI-assisted software incorporating a deep learning (DL) model based on static ultrasound images. The software aims to aid physicians in distinguishing between malignant and benign thyroid nodules with echogenic foci and to investigate how the AI-assisted DL model can enhance radiologists' diagnostic performance. Methods For this retrospective study, a total of 2724 ultrasound (US) scans were collected from two independent institutions, encompassing 1038 echogenic foci nodules. All echogenic foci were confirmed by pathology. Three DL segmentation models (DeepLabV3+, U-Net, and PSPNet) were developed, with each model using two different backbones to extract features from the nodular regions with echogenic foci. Evaluation indexes such as Mean Intersection over Union (MIoU), Mean Pixel Accuracy (MPA), and Dice coefficients were employed to assess the performance of the segmentation model. The model demonstrating the best performance was selected to develop the AI-assisted diagnostic software, enabling radiologists to benefit from AI-assisted diagnosis. The diagnostic performance of radiologists with varying levels of seniority and beginner radiologists in assessing high-echo nodules was then compared, both with and without the use of auxiliary strategies. The area under the receiver operating characteristic curve (AUROC) was used as the primary evaluation index, both with and without the use of auxiliary strategies. Results In the analysis of Institution 2, the DeepLabV3+ (backbone is MobileNetV2 exhibited optimal segmentation performance, with MIoU = 0.891, MPA = 0.945, and Dice = 0.919. The combined AUROC (0.693 [95% CI 0.595-0.791]) of radiology beginners using AI-assisted strategies was significantly higher than those without such strategies (0.551 [0.445-0.657]). Additionally, the combined AUROC of junior physicians employing adjuvant strategies improved from 0.674 [0.574-0.774] to 0.757 [0.666-0.848]. Similarly, the combined AUROC of senior physicians increased slightly, rising from 0.745 [0.652-0.838] to 0.813 [0.730-0.896]. With the implementation of AI-assisted strategies, the accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of both senior physicians and beginners in the radiology department underwent varying degrees of improvement. Conclusions This study demonstrates that the DL-based auxiliary diagnosis model using US static images can improve the performance of radiologists and radiology students in identifying thyroid echogenic foci.

Deep Learning Analysis with Gray Scale and Doppler Ultrasonography Images to Differentiate Graves’ Disease

Preliminary study on thyroid ultrasound image restoration algorithm based on deep learning

Deep learning based on ultrasound to differentiate pathologically proven atypical and typical medullary thyroid carcinoma from follicular thyroid adenoma

Ultrasound-based deep learning using the VGGNet model for the differentiation of benign and malignant thyroid nodules: A meta-analysis

Ultrasound Image Classification of Thyroid Nodules Based on Deep Learning

Deep learning diagnostic performance and visual insights in differentiating benign and malignant thyroid nodules on ultrasound images

Deep learning for the diagnosis of suspicious thyroid nodules based on multimodal ultrasound images

Deep convolutional neural networks in thyroid disease detection: A multi-classification comparison by ultrasonography and computed tomography

Deep learning to diagnose Hashimoto’s thyroiditis from sonographic images

Deep Learning Based on ACR TI-RADS Can Improve the Differential Diagnosis of Thyroid Nodules

Thyroid ultrasound image classification using a convolutional neural network

Automatic Classification of Nodules from 2D Ultrasound Images Using Deep Learning Networks

Deep learning for classification of thyroid nodules on ultrasound: validation on an independent dataset

The Auxiliary Diagnosis of Thyroid Echogenic Foci Based on a Deep Learning Segmentation Model: A Two-Center Study

Deep-learning models for differentiation of xanthogranulomatous cholecystitis and gallbladder cancer on ultrasound

Application of machine learning to ultrasound images to differentiate follicular neoplasms of the thyroid gland

A Multi-View Deep Learning Model for Thyroid Nodules Detection and Characterization in Ultrasound Imaging

Hybrid deep learning assisted multi classification: Grading of malignant thyroid nodules

Deep learning-assisted ultrasonic diagnosis of cervical lymph node metastasis of thyroid cancer: a retrospective study of 3059 patients

Using Deep Neural Network to Diagnose Thyroid Nodules on Ultrasound in Patients With Hashimoto’s Thyroiditis

Ultrasound-based differentiation of malignant and benign thyroid Nodules: An extreme learning machine approach