Abstract:Objectives This study aimed to differentially diagnose thyroid nodules (TNs) of Thyroid Imaging Reporting and Data System (TI-RADS) 3–5 categories using a deep learning (DL) model based on multimodal ultrasound (US) images and explore its auxiliary role for radiologists with varying degrees of experience. Methods Preoperative multimodal US images of 1,138 TNs of TI-RADS 3–5 categories were randomly divided into a training set (n = 728), a validation set (n = 182), and a test set (n = 228) in a 4:1:1.25 ratio. Grayscale US (GSU), color Doppler flow imaging (CDFI), strain elastography (SE), and region of interest mask (Mask) images were acquired in both transverse and longitudinal sections, all of which were confirmed by pathology. In this study, fivefold cross-validation was used to evaluate the performance of the proposed DL model. The diagnostic performance of the mature DL model and radiologists in the test set was compared, and whether DL could assist radiologists in improving diagnostic performance was verified. Specificity, sensitivity, accuracy, positive predictive value, negative predictive value, and area under the receiver operating characteristics curves (AUC) were obtained. Results The AUCs of DL in the differentiation of TNs were 0.858 based on (GSU + SE), 0.909 based on (GSU + CDFI), 0.906 based on (GSU + CDFI + SE), and 0.881 based (GSU + Mask), which were superior to that of 0.825-based single GSU ( p = 0.014, p < 0.001, p < 0.001, and p = 0.002, respectively). The highest AUC of 0.928 was achieved by DL based on (G + C + E + M)US, the highest specificity of 89.5% was achieved by (G + C + E)US, and the highest accuracy of 86.2% and sensitivity of 86.9% were achieved by DL based on (G + C + M)US. With DL assistance, the AUC of junior radiologists increased from 0.720 to 0.796 ( p < 0.001), which was slightly higher than that of senior radiologists without DL assistance (0.796 vs. 0.794, p > 0.05). Senior radiologists with DL assistance exhibited higher accuracy and comparable AUC than that of DL based on GSU (83.4% vs. 78.9%, p = 0.041; 0.822 vs. 0.825, p = 0.512). However, the AUC of DL based on multimodal US images was significantly higher than that based on visual diagnosis by radiologists ( p < 0.05). Conclusion The DL models based on multimodal US images showed exceptional performance in the differential diagnosis of suspicious TNs, effectively increased the diagnostic efficacy of TN evaluations by junior radiologists, and provided an objective assessment for the clinical and surgical management phases that follow.

Development of novel deep multimodal representation learning‐based model for the differentiation of liver tumors on B‐mode ultrasound images

Deep Learning Radiomics for Focal Liver Lesions Diagnosis on Long-Range Contrast-Enhanced Ultrasound and Clinical Factors

Deep Learning for Accurate Diagnosis of Liver Tumor Based on Magnetic Resonance Imaging and Clinical Data

Improving B-mode Ultrasound Diagnostic Performance for Focal Liver Lesions Using Deep Learning: A Multicentre Study

Deep Learning-Assisted Diagnosis of Liver Tumors Using Non-Contrast Magnetic Resonance Imaging: A Multi-Center Study

Multimodal Ultrasound Imaging Based Diagnosis of Liver Cancers with a Two-Stage Multi-View Learning Framework.

Applicability of Multidimensional Convolutional Neural Networks on Automated Detection of Diverse Focal Liver Lesions in Multiphase CT Images.

Transport-Based Anatomical-Functional Metric Learning for Liver Tumor Recognition Using Dual-View Dynamic CEUS Imaging.

Multi-Source Transfer Learning Via Multi-Kernel Support Vector Machine Plus for B-Mode Ultrasound-Based Computer-Aided Diagnosis of Liver Cancers

US-Based Deep Learning Model for Differentiating Hepatocellular Carcinoma (HCC) From Other Malignancy in Cirrhotic Patients

B-mode ultrasound based CAD for liver cancers via multi-view privileged information learning

Preoperative diagnosis and prediction of hepatocellular carcinoma: Radiomics analysis based on multi-modal ultrasound images

Deep learning for the diagnosis of suspicious thyroid nodules based on multimodal ultrasound images

A study on liver tumor detection from an ultrasound image using deep learning

Deep learning for differential diagnosis of malignant hepatic tumors based on multi-phase contrast-enhanced CT and clinical data

Deep learning‐based multimodal fusion network for segmentation and classification of breast cancers using B‐mode and elastography ultrasound images

A novel multimodal deep learning model for preoperative prediction of microvascular invasion and outcome in hepatocellular carcinoma

A non-invasive predictive model based on multimodality ultrasonography images to differentiate malignant from benign focal liver lesions

Deep Learning for Distinguishing Mucinous Breast Carcinoma From Fibroadenoma on Ultrasound

A Two-Stage Multi-View Learning Framework Based Computer-Aided Diagnosis of Liver Tumors with Contrast Enhanced Ultrasound Images.

Improving artificial intelligence pipeline for liver malignancy diagnosis using ultrasound images and video frames