Abstract:PURPOSE Clinically, the risk stratification of thyroid nodules is usually used to formulate the next treatment plan. The American College of Radiology (ACR) Thyroid Imaging Reporting and Data System (TI-RADS) is a kind of medical standard widely used in classification diagnosis. It divides the nodule's ACR TI-RADS level into five levels by quantitative scoring, from benign to high suspicion of malignancy. However, such assessment often relies on the radiologists' experience and is time consuming. So Computer Aided Diagnosis is necessary. But many Deep Learning (DL) models are difficult for doctors to understand, limiting their applicability in clinical practice. In this work, we mainly focus on how to achieve automatic thyroid nodules risk stratification based on deep integration of deep learning and clinical experience. METHODS An automatic hierarchical method of thyroid nodules risk based on deep learning is proposed, called risk stratification network (RS-Net). It incorporates medical experience based on ACR TI-RADS. The convolutional neural network (CNN) is used to classify the five categories in ACR TI-RADS and assign their points respectively. According to the point totals, the level of risk can be obtained. In addition, a dataset involving 13984 thyroid ultrasound images is established to develop and evaluate the proposed method. RESULTS We have extensively compared the results of this paper with the evaluation results of sonographers. The accuracy of the risk stratification (TR1 to TR5) of the proposed method is 65%, and the mean absolute error (MAE) is 0.54. The MAE of the point totals (0 to 13 points) is 1.67. The Pearson's correlation between our method evaluation and doctor evaluation reached 0.84. For the benign and malignant classification, the performance indices accuracy, sensitivity, specificity, PPV, and NPV were 88.0%, 98.1%, 79.1%, 80.5%, and 97.9%, respectively. Our method's level of thyroid nodules risk stratification is comparable to that of a senior doctor. CONCLUSIONS This work provides a way to automate the risk stratification of thyroid nodules. Our method can effectively avoid missed diagnosis and misdiagnosis caused by the difference of observers so as to assist doctors to improve efficiency and diagnosis rate. And compared with the previous benign and malignant classification, the proposed method incorporates clinical experience. So it can greatly increase the clinicians' trust in the DL model, thereby improving the applicability of the model in clinical practice.

A Hybrid Deep Learning and Handcrafted Features Based Approach for Thyroid Nodule Classification in Ultrasound Images

Ultrasound Image Classification of Thyroid Nodules Based on Deep Learning

Deep Learning and Handcrafted Features for Thyroid Nodule Classification

Thyroid Nodule Classification in Ultrasound Images by Fine-Tuning Deep Convolutional Neural Network

Thyroid Nodule Ultrasound Image Classification Through Hybrid Feature Cropping Network

Research on The Identification of Benign and Malignant Thyroid Nodule Ultrasound Images Based on Deep Learning Model

An Intelligent Platform for Ultrasound Diagnosis of Thyroid Nodules

A New Classification Method in Ultrasound Images of Benign and Malignant Thyroid Nodules Based on Transfer Learning and Deep Convolutional Neural Network

Thyroid Nodule Detection in Ultrasound Images with Convolutional Neural Networks

Thyroid Nodules Risk Stratification Through Deep Learning Based on Ultrasound Images

A Deep Learning Framework for the Characterization of Thyroid Nodules from Ultrasound Images Using Improved Inception Network and Multi-Level Transfer Learning

Automatic Classification of Nodules from 2D Ultrasound Images Using Deep Learning Networks

Identification method of thyroid nodule ultrasonography based on self-supervised learning dual-branch attention learning framework

A pre-trained convolutional neural network based method for thyroid nodule diagnosis.

Automatic Classification of Thyroid Nodules in Ultrasound Images Using a Multi-Task Attention Network Guided by Clinical Knowledge

Automated Detection and Classification of Thyroid Nodules in Ultrasound Images Using Clinical-Knowledge-guided Convolutional Neural Networks

Ensemble Deep Learning Model for Multicenter Classification of Thyroid Nodules on Ultrasound Images

A Local and Global Feature Disentangled Network: Toward Classification of Benign-malignant Thyroid Nodules from Ultrasound Image

Thyroid ultrasound image classification using a convolutional neural network

Classification of a Small-data-set Thyroid Nodules Based on Supplementary Feature Layer Improved VGG16

Deep learning for classification of thyroid nodules on ultrasound: validation on an independent dataset