Abstract:Thyroid ultrasonography is a widely used clinical technique for nodule diagnosis in thyroid regions. However, it remains difficult to detect and recognize the nodules due to low contrast, high noise, and diverse appearance of nodules. In today's clinical practice, senior doctors could pinpoint nodules by analyzing global context features, local geometry structure, and intensity changes, which would require rich clinical experience accumulated from hundreds and thousands of nodule case studies. To alleviate doctors' tremendous labor in the diagnosis procedure, we advocate a machine learning approach to the detection and recognition tasks in this paper. In particular, we develop a multitask cascade convolution neural network (MC-CNN) framework to exploit the context information of thyroid nodules. It may be noted that our framework is built upon a large number of clinically confirmed thyroid ultrasound images with accurate and detailed ground truth labels. Other key advantages of our framework result from a multitask cascade architecture, two stages of carefully designed deep convolution networks in order to detect and recognize thyroid nodules in a pyramidal fashion, and capturing various intrinsic features in a global-to-local way. Within our framework, the potential regions of interest after initial detection are further fed to the spatial pyramid augmented CNNs to embed multiscale discriminative information for fine-grained thyroid recognition. Experimental results on 4309 clinical ultrasound images have indicated that our MC-CNN is accurate and effective for both thyroid nodules detection and recognition. For the correct diagnosis rate of malignant and benign thyroid nodules, its mean Average Precision (mAP) performance can achieve up to [Formula: see text] accuracy, which outperforms the common CNNs by [Formula: see text] on average. In addition, we conduct rigorous user studies to confirm that our MC-CNN outperforms experienced doctors, yet only consuming roughly [Formula: see text] ( 1/48) of doctors' examination time on average. Therefore, the accuracy and efficiency of our new method exhibit its great potential in clinical applications.

A Knowledge-Interpretable Multi-Task Learning Framework for Automated Thyroid Nodule Diagnosis in Ultrasound Videos.

Reinforced Computer-Aided Framework for Diagnosing Thyroid Cancer.

Automatic Classification of Thyroid Nodules in Ultrasound Images Using a Multi-Task Attention Network Guided by Clinical Knowledge

Automated Detection and Classification of Thyroid Nodules in Ultrasound Images Using Clinical-Knowledge-guided Convolutional Neural Networks

Diagnosis of Thyroid Nodules in Ultrasound Images Using Two Combined Classification Modules

Key-frame Guided Network for Thyroid Nodule Recognition using Ultrasound Videos

Video-based AI module with raw-scale and ROI-scale information for thyroid nodule diagnosis

Semi-supervised Thyroid Nodule Detection in Ultrasound Videos

Clinical knowledge embedded method based on multi-task learning for thyroid nodule classification with ultrasound images

Multitask Cascade Convolution Neural Networks for Automatic Thyroid Nodule Detection and Recognition

Multi-Attribute Attention Network for Interpretable Diagnosis of Thyroid Nodules in Ultrasound Images

A multi-task model for reliable classification of thyroid nodules in ultrasound images

CacheTrack-YOLO: Real-Time Detection and Tracking for Thyroid Nodules and Surrounding Tissues in Ultrasound Videos

Self-supervised enhanced thyroid nodule detection in ultrasound examination video sequences with multi-perspective evaluation

Fully Automated Diagnosis of Thyroid Nodule Ultrasound Using Brain-Inspired Inference

Detecting thyroid nodules along with surrounding tissues and tracking nodules using motion prior in ultrasound videos

Thyroid Nodule Classification in Ultrasound Videos by Combining 3D CNN and Video Transformer

Multimodal Feature Fusion and Knowledge-Driven Learning via Experts Consult for Thyroid Nodule Classification

Attribute-aware Interpretation Learning for Thyroid Ultrasound Diagnosis

Self-supervised Learning Enhanced Ultrasound Video Thyroid Nodule Tracking

Automatic ultrasound diagnosis of thyroid nodules: a combination of deep learning and KWAK TI-RADS