Abstract:Thyroid ultrasonography is a widely used clinical technique for nodule diagnosis in thyroid regions. However, it remains difficult to detect and recognize the nodules due to low contrast, high noise, and diverse appearance of nodules. In today's clinical practice, senior doctors could pinpoint nodules by analyzing global context features, local geometry structure, and intensity changes, which would require rich clinical experience accumulated from hundreds and thousands of nodule case studies. To alleviate doctors' tremendous labor in the diagnosis procedure, we advocate a machine learning approach to the detection and recognition tasks in this paper. In particular, we develop a multitask cascade convolution neural network (MC-CNN) framework to exploit the context information of thyroid nodules. It may be noted that our framework is built upon a large number of clinically confirmed thyroid ultrasound images with accurate and detailed ground truth labels. Other key advantages of our framework result from a multitask cascade architecture, two stages of carefully designed deep convolution networks in order to detect and recognize thyroid nodules in a pyramidal fashion, and capturing various intrinsic features in a global-to-local way. Within our framework, the potential regions of interest after initial detection are further fed to the spatial pyramid augmented CNNs to embed multiscale discriminative information for fine-grained thyroid recognition. Experimental results on 4309 clinical ultrasound images have indicated that our MC-CNN is accurate and effective for both thyroid nodules detection and recognition. For the correct diagnosis rate of malignant and benign thyroid nodules, its mean Average Precision (mAP) performance can achieve up to [Formula: see text] accuracy, which outperforms the common CNNs by [Formula: see text] on average. In addition, we conduct rigorous user studies to confirm that our MC-CNN outperforms experienced doctors, yet only consuming roughly [Formula: see text] ( 1/48) of doctors' examination time on average. Therefore, the accuracy and efficiency of our new method exhibit its great potential in clinical applications.

Thyroid Nodule Classification in Ultrasound Videos by Combining 3D CNN and Video Transformer

Diagnosis of Thyroid Nodules in Ultrasound Images Using Two Combined Classification Modules

Key-frame Guided Network for Thyroid Nodule Recognition using Ultrasound Videos

Semi-supervised Thyroid Nodule Detection in Ultrasound Videos

A Knowledge-Interpretable Multi-Task Learning Framework for Automated Thyroid Nodule Diagnosis in Ultrasound Videos.

Video-based AI module with raw-scale and ROI-scale information for thyroid nodule diagnosis

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

Multitask Cascade Convolution Neural Networks for Automatic Thyroid Nodule Detection and Recognition

Self-supervised enhanced thyroid nodule detection in ultrasound examination video sequences with multi-perspective evaluation

Self-supervised Learning Enhanced Ultrasound Video Thyroid Nodule Tracking

Cascade Convolutional Neural Networks for Automatic Detection of Thyroid Nodules in Ultrasound Images

Thyroid Nodule Classification in Ultrasound Images by Fine-Tuning Deep Convolutional Neural Network

Ultrasound Image Classification of Thyroid Nodules Based on Deep Learning

A Novel Ultrasound Image Diagnostic Method for Thyroid Nodules

An Intelligent Platform for Ultrasound Diagnosis of Thyroid Nodules

Thyroid Nodule Detection in Ultrasound Images with Convolutional Neural Networks

Classification of Thyroid Nodules by Using Deep Learning Radiomics Based on Ultrasound Dynamic Video

A pre-trained convolutional neural network based method for thyroid nodule diagnosis.

Detecting thyroid nodules along with surrounding tissues and tracking nodules using motion prior in ultrasound videos

Reliable Thyroid Carcinoma Detection with Real-Time Intelligent Analysis of Ultrasound Images

A New Classification Method in Ultrasound Images of Benign and Malignant Thyroid Nodules Based on Transfer Learning and Deep Convolutional Neural Network