Abstract:Purpose: Assessment of thyroid nodules is usually relied on the experience of the radiologist and is time-consuming. Classification model of thyroid nodules cannot only reduce the burden on physicians but also provide objective recommendations. However, most classification models based on deep learning simply give a prediction result of the benignity or malignancy of nodules; thus, physicians have no way of knowing how the deep learning gets the prediction result due to the black-box nature of neural networks. In this work, we integrate the explainability directly into the outputs generated by the model through combining thyroid imaging reporting and data system (TI-RADS). The inference process of the proposed method is consistent with doctor's clinical diagnosis process; therefore, doctors can better explain the diagnosis results of the model to the patient. Methods: A multitask network based on TI-RADS (MTN-TI-RADS) for the classification of thyroid nodules is proposed. In this network, a set of TI-RADS classifications of nodules is first obtained by multitask learning, then the TI-RADS points and the corresponding risk levels are calculated, and finally, nodules are classified as benign and malignant. The classification process through the network is consistent with the diagnostic process of physician; thus, the results of classification can be easily understood by physicians. In addition, the attention modules are introduced to the spatial and channel domains to let the network focus more on critical features. Results: To verify the classification performance of our method, we compared the results obtained through our method with the results of the radiologist's evaluation. For the 781 test nodules in the internal dataset and the 886 test nodules in the external dataset, the sensitivity and specificity of MTN-TI-RADS were 0.988, 0.912 in internal dataset, 0.949, 0.930 in external dataset, versus the senior radiologist of 0.925 ( p < 0.001 $p<0.001$ ), 0.816 ( p = 0.005 $p=0.005$ ), and 0.910 ( p = 0.009 $p=0.009$ ), 0.836 ( p < 0.001 $p<0.001$ ), respectively. And the area under the receiver operating characteristic curve of MTN-TI-RADS was 0.981 in internal dataset, 0.973 in external dataset, versus the senior radiologist of 0.905, 0.923. For the internal dataset, we also computed the accuracy of the risk level (TR1 to TR5) and the mean absolute error (MAE). The accuracy of the risk level of the proposed method is 78%, and the MAE is 1.30. The MAE of the total points (0-14 points) is 1.30. Conclusions: An effective and result-interpretable end-to-end thyroid nodule classification network (MTN-TI-RADS) is proposed. MTN-TI-RADS has superior ability to classify malignant and benign thyroid nodules compared to senior radiologists. Based on MTN-TI-RADS, a classification model with strong interpretation and a high degree of physician trust is constructed. The proposed classification network is consistent with the diagnosis process of physicians, thus is more reliable and interpretable, and has great potential for clinical application.

Shape-Margin Knowledge Augmented Network for Thyroid Nodule Segmentation and Diagnosis

Shape-Margin Knowledge Augmented Network for Thyroid Nodule Segmentation and Diagnosis

Segmentation of Thyroid Glands and Nodules in Ultrasound Images Using the Improved U-Net Architecture.

A segmentation-based algorithm for classification of benign and malignancy Thyroid nodules with multi-feature information

A Two-Stage Network with Prior Knowledge Guidance for Medullary Thyroid Carcinoma Recognition in Ultrasound Images.

A Super-resolution Guided Network for Improving Automated Thyroid Nodule Segmentation

Automatic Classification of Thyroid Nodules in Ultrasound Images Using a Multi-Task Attention Network Guided by Clinical Knowledge

An interpretable two-branch bi-coordinate network based on multi-grained domain knowledge for classification of thyroid nodules in ultrasound images

A multi-task model for reliable classification of thyroid nodules in ultrasound images

Automated Detection and Classification of Thyroid Nodules in Ultrasound Images Using Clinical-Knowledge-guided Convolutional Neural Networks

SDA-Net: Self-distillation Driven Deformable Attentive Aggregation Network for Thyroid Nodule Identification in Ultrasound Images

Multitask network for thyroid nodule diagnosis based on TI-RADS

Automatic ultrasound diagnosis of thyroid nodules: a combination of deep learning and KWAK TI-RADS

Local and Context-Attention Adaptive LCA-Net for Thyroid Nodule Segmentation in Ultrasound Images

Mamba- and ResNet-Based Dual-Branch Network for Ultrasound Thyroid Nodule Segmentation

Multimodal Feature Fusion and Knowledge-Driven Learning via Experts Consult for Thyroid Nodule Classification

Localization and Risk Stratification of Thyroid Nodules in Ultrasound Images Through Deep Learning

Automated Segmentation of Thyroid Nodule, Gland, and Cystic Components From Ultrasound Images Using Deep Learning

Multi-Attribute Attention Network for Interpretable Diagnosis of Thyroid Nodules in Ultrasound Images

Automatic Diagnosis for Thyroid Nodules in Ultrasound Images by Deep Neural Networks.

Thyroid Nodules Risk Stratification Through Deep Learning Based on Ultrasound Images