Abstract:BackgroundThe aim of this study was to construct a deep convolutional neural network (CNN) model for localization and diagnosis of thyroid nodules on ultrasound and evaluate its diagnostic performance.MethodsWe developed and trained a deep CNN model called the Brief Efficient Thyroid Network (BETNET) using 16,401 ultrasound images. According to the parameters of the model, we developed a computer-aided diagnosis (CAD) system to localize and differentiate thyroid nodules. The validation dataset (1,000 images) was used to compare the diagnostic performance of the model using three state-of-the-art algorithms. We used an internal test set (300 images) to evaluate the BETNET model by comparing it with diagnoses from five radiologists with varying degrees of experience in thyroid nodule diagnosis. Lastly, we demonstrated the general applicability of our artificial intelligence (AI) system for diagnosing thyroid cancer in an external test set (1,032 images).ResultsThe BETNET model accurately detected thyroid nodules in visualization experiments. The model demonstrated higher values for area under the receiver operating characteristic (AUC-ROC) curve [0.983, 95% confidence interval (CI): 0.973-0.990], sensitivity (99.19%), accuracy (98.30%), and Youden index (0.9663) than the three state-of-the-art algorithms (P<0.05). In the internal test dataset, the diagnostic accuracy of the BETNET model was 91.33%, which was markedly higher than the accuracy of one experienced (85.67%) and two less experienced radiologists (77.67% and 69.33%). The area under the ROC curve of the BETNET model (0.951) was similar to that of the two highly skilled radiologists (0.940 and 0.953) and significantly higher than that of one experienced and two less experienced radiologists (P<0.01). The kappa coefficient of the BETNET model and the pathology results showed good agreement (0.769). In addition, the BETNET model achieved an excellent diagnostic performance (AUC =0.970, 95% CI: 0.958-0.980) when applied to ultrasound images from another independent hospital.ConclusionsWe developed a deep learning model which could accurately locate and automatically diagnose thyroid nodules on ultrasound images. The BETNET model exhibited better diagnostic performance than three state-of-the-art algorithms, which in turn performed similarly in diagnosis as the experienced radiologists. The BETNET model has the potential to be applied to ultrasound images from other hospitals.

Bilinear Pooling for Thyroid Nodule Classification in Ultrasound Imaging

Diagnosis of Thyroid Nodules in Ultrasound Images Using Two Combined Classification Modules

Computer-Aided Diagnosis of Thyroid Nodule from Ultrasound Images Using Transfer Learning from Deep Convolutional Neural Network Models

Multitask Cascade Convolution Neural Networks for Automatic Thyroid Nodule Detection and Recognition

Deep Learning and Handcrafted Features for Thyroid Nodule Classification

Automatic Diagnosis for Thyroid Nodules in Ultrasound Images by Deep Neural Networks.

An Efficient Deep Convolutional Neural Network Model for Visual Localization and Automatic Diagnosis of Thyroid Nodules on Ultrasound Images.

Cascade Convolutional Neural Networks for Automatic Detection of Thyroid Nodules in Ultrasound Images

A New Classification Method in Ultrasound Images of Benign and Malignant Thyroid Nodules Based on Transfer Learning and Deep Convolutional Neural Network

An Intelligent Platform for Ultrasound Diagnosis of Thyroid Nodules

Thyroid Nodule Classification in Ultrasound Images by Fine-Tuning Deep Convolutional Neural Network

Automatic Classification of Nodules from 2D Ultrasound Images Using Deep Learning Networks

Ultrasound Image Classification of Thyroid Nodules Based on Deep Learning

Automated Detection and Classification of Thyroid Nodules in Ultrasound Images Using Clinical-Knowledge-guided Convolutional Neural Networks

Thyroid ultrasound image classification using a convolutional neural network

A Hybrid Deep Learning and Handcrafted Features Based Approach for Thyroid Nodule Classification in Ultrasound Images

Residual U-Net approach for thyroid nodule detection and classification from thyroid ultrasound images

Automated Segmentation of Thyroid Nodule, Gland, and Cystic Components From Ultrasound Images Using Deep Learning

A pre-trained convolutional neural network based method for thyroid nodule diagnosis.

A generic deep learning framework to classify thyroid and breast lesions in ultrasound images

A Novel Ultrasound Image Diagnostic Method for Thyroid Nodules