Abstract:PURPOSE Clinically, the risk stratification of thyroid nodules is usually used to formulate the next treatment plan. The American College of Radiology (ACR) Thyroid Imaging Reporting and Data System (TI-RADS) is a kind of medical standard widely used in classification diagnosis. It divides the nodule's ACR TI-RADS level into five levels by quantitative scoring, from benign to high suspicion of malignancy. However, such assessment often relies on the radiologists' experience and is time consuming. So Computer Aided Diagnosis is necessary. But many Deep Learning (DL) models are difficult for doctors to understand, limiting their applicability in clinical practice. In this work, we mainly focus on how to achieve automatic thyroid nodules risk stratification based on deep integration of deep learning and clinical experience. METHODS An automatic hierarchical method of thyroid nodules risk based on deep learning is proposed, called risk stratification network (RS-Net). It incorporates medical experience based on ACR TI-RADS. The convolutional neural network (CNN) is used to classify the five categories in ACR TI-RADS and assign their points respectively. According to the point totals, the level of risk can be obtained. In addition, a dataset involving 13984 thyroid ultrasound images is established to develop and evaluate the proposed method. RESULTS We have extensively compared the results of this paper with the evaluation results of sonographers. The accuracy of the risk stratification (TR1 to TR5) of the proposed method is 65%, and the mean absolute error (MAE) is 0.54. The MAE of the point totals (0 to 13 points) is 1.67. The Pearson's correlation between our method evaluation and doctor evaluation reached 0.84. For the benign and malignant classification, the performance indices accuracy, sensitivity, specificity, PPV, and NPV were 88.0%, 98.1%, 79.1%, 80.5%, and 97.9%, respectively. Our method's level of thyroid nodules risk stratification is comparable to that of a senior doctor. CONCLUSIONS This work provides a way to automate the risk stratification of thyroid nodules. Our method can effectively avoid missed diagnosis and misdiagnosis caused by the difference of observers so as to assist doctors to improve efficiency and diagnosis rate. And compared with the previous benign and malignant classification, the proposed method incorporates clinical experience. So it can greatly increase the clinicians' trust in the DL model, thereby improving the applicability of the model in clinical practice.

Deep learning-based computer-aided diagnosis system for the automatic detection and classification of lateral cervical lymph nodes on original ultrasound images of papillary thyroid carcinoma: a prospective diagnostic study

Ultrasound-based computer-aided diagnosis for cytologically indeterminate thyroid nodules with different radiologists.

Evaluation of a Deep Learning-Based Computer-Aided Diagnosis System for Distinguishing Benign from Malignant Thyroid Nodules in Ultrasound Images.

Automated Detection and Classification of Thyroid Nodules in Ultrasound Images Using Clinical-Knowledge-guided Convolutional Neural Networks

Diagnosis of Thyroid Nodules in Ultrasound Images Using Two Combined Classification Modules

A Review of the Role of the S-Detect Computer-Aided Diagnostic Ultrasound System in the Evaluation of Benign and Malignant Breast and Thyroid Masses.

A Novel Intelligent Thyroid Nodule Diagnosis System over Ultrasound Images Based on Deep Learning

Automatic ultrasound diagnosis of thyroid nodules: a combination of deep learning and KWAK TI-RADS

A computer-aided diagnosing system in the evaluation of thyroid nodules-experience in a specialized thyroid center

DeepThy‐Net: A Multimodal Deep Learning Method for Predicting Cervical Lymph Node Metastasis in Papillary Thyroid Cancer

Multi-modal ultrasound multistage classification of PTC cervical lymph node metastasis via DualSwinThyroid

Computer-Aided Diagnosis Systems in Diagnosing Malignant Thyroid Nodules on Ultrasonography: A Systematic Review and Meta-Analysis

A Machine Learning-based Diagnosis of Thyroid Cancer Using Thyroid Nodules Ultrasound Images

Diagnosis of thyroid cancer using a TI-RADS-based computer-aided diagnosis system: a multicenter retrospective study

Thyroid Nodules Risk Stratification Through Deep Learning Based on Ultrasound Images

An improved deep learning approach for detection of thyroid papillary cancer in ultrasound images

Differential Diagnosis and Feature Visualization for Thyroid Nodules Using Computer-Aided Ultrasonic Diagnosis System: Initial Clinical Assessment

Automatic Diagnosis for Thyroid Nodules in Ultrasound Images by Deep Neural Networks.

Deep Learning and Handcrafted Features for Thyroid Nodule Classification

[A Thyroid Ultrasound Image-based Artificial Intelligence Model for Diagnosis of Central Compartment Lymph Node Metastasis in Papillary Thyroid Carcinoma].

Ensemble Deep Learning Model for Multicenter Classification of Thyroid Nodules on Ultrasound Images