Abstract:BackgroundThe aim of this study was to construct a deep convolutional neural network (CNN) model for localization and diagnosis of thyroid nodules on ultrasound and evaluate its diagnostic performance.MethodsWe developed and trained a deep CNN model called the Brief Efficient Thyroid Network (BETNET) using 16,401 ultrasound images. According to the parameters of the model, we developed a computer-aided diagnosis (CAD) system to localize and differentiate thyroid nodules. The validation dataset (1,000 images) was used to compare the diagnostic performance of the model using three state-of-the-art algorithms. We used an internal test set (300 images) to evaluate the BETNET model by comparing it with diagnoses from five radiologists with varying degrees of experience in thyroid nodule diagnosis. Lastly, we demonstrated the general applicability of our artificial intelligence (AI) system for diagnosing thyroid cancer in an external test set (1,032 images).ResultsThe BETNET model accurately detected thyroid nodules in visualization experiments. The model demonstrated higher values for area under the receiver operating characteristic (AUC-ROC) curve [0.983, 95% confidence interval (CI): 0.973-0.990], sensitivity (99.19%), accuracy (98.30%), and Youden index (0.9663) than the three state-of-the-art algorithms (P<0.05). In the internal test dataset, the diagnostic accuracy of the BETNET model was 91.33%, which was markedly higher than the accuracy of one experienced (85.67%) and two less experienced radiologists (77.67% and 69.33%). The area under the ROC curve of the BETNET model (0.951) was similar to that of the two highly skilled radiologists (0.940 and 0.953) and significantly higher than that of one experienced and two less experienced radiologists (P<0.01). The kappa coefficient of the BETNET model and the pathology results showed good agreement (0.769). In addition, the BETNET model achieved an excellent diagnostic performance (AUC =0.970, 95% CI: 0.958-0.980) when applied to ultrasound images from another independent hospital.ConclusionsWe developed a deep learning model which could accurately locate and automatically diagnose thyroid nodules on ultrasound images. The BETNET model exhibited better diagnostic performance than three state-of-the-art algorithms, which in turn performed similarly in diagnosis as the experienced radiologists. The BETNET model has the potential to be applied to ultrasound images from other hospitals.

Deep Learning and Handcrafted Features for Thyroid Nodule Classification

A Hybrid Deep Learning and Handcrafted Features Based Approach for Thyroid Nodule Classification in Ultrasound Images

Automated Detection and Classification of Thyroid Nodules in Ultrasound Images Using Clinical-Knowledge-guided Convolutional Neural Networks

Diagnosis of Thyroid Nodules in Ultrasound Images Using Two Combined Classification Modules

Automatic Classification of Nodules from 2D Ultrasound Images Using Deep Learning Networks

Evaluation of a Deep Learning-Based Computer-Aided Diagnosis System for Distinguishing Benign from Malignant Thyroid Nodules in Ultrasound Images.

Thyroid Nodule Classification in Ultrasound Images by Fine-Tuning Deep Convolutional Neural Network

Research on Thyroid Cancer Detection and Classification Using Deep Learning over Ultrasound Images

Artificial Intelligence-Based Thyroid Nodule Classification Using Information from Spatial and Frequency Domains

Bilinear Pooling for Thyroid Nodule Classification in Ultrasound Imaging

Automatic Diagnosis for Thyroid Nodules in Ultrasound Images by Deep Neural Networks.

Non-invasive automated 3D thyroid lesion classification in ultrasound: a class of ThyroScan™ systems

Automatic Detection of Thyroid Nodule Characteristics From 2D Ultrasound Images

Computer-Aided Diagnosis of Thyroid Nodule from Ultrasound Images Using Transfer Learning from Deep Convolutional Neural Network Models

Deep convolutional neural networks in thyroid disease detection: A multi-classification comparison by ultrasonography and computed tomography

An improved deep learning approach for detection of thyroid papillary cancer in ultrasound images

An Intelligent Platform for Ultrasound Diagnosis of Thyroid Nodules

An Efficient Deep Convolutional Neural Network Model for Visual Localization and Automatic Diagnosis of Thyroid Nodules on Ultrasound Images.

Ultrasound Image-Based Diagnosis of Malignant Thyroid Nodule Using Artificial Intelligence

A Machine Learning-based Diagnosis of Thyroid Cancer Using Thyroid Nodules Ultrasound Images

Multitask Cascade Convolution Neural Networks for Automatic Thyroid Nodule Detection and Recognition