Abstract:Thyroid ultrasonography is a widely used clinical technique for nodule diagnosis in thyroid regions. However, it remains difficult to detect and recognize the nodules due to low contrast, high noise, and diverse appearance of nodules. In today's clinical practice, senior doctors could pinpoint nodules by analyzing global context features, local geometry structure, and intensity changes, which would require rich clinical experience accumulated from hundreds and thousands of nodule case studies. To alleviate doctors' tremendous labor in the diagnosis procedure, we advocate a machine learning approach to the detection and recognition tasks in this paper. In particular, we develop a multitask cascade convolution neural network (MC-CNN) framework to exploit the context information of thyroid nodules. It may be noted that our framework is built upon a large number of clinically confirmed thyroid ultrasound images with accurate and detailed ground truth labels. Other key advantages of our framework result from a multitask cascade architecture, two stages of carefully designed deep convolution networks in order to detect and recognize thyroid nodules in a pyramidal fashion, and capturing various intrinsic features in a global-to-local way. Within our framework, the potential regions of interest after initial detection are further fed to the spatial pyramid augmented CNNs to embed multiscale discriminative information for fine-grained thyroid recognition. Experimental results on 4309 clinical ultrasound images have indicated that our MC-CNN is accurate and effective for both thyroid nodules detection and recognition. For the correct diagnosis rate of malignant and benign thyroid nodules, its mean Average Precision (mAP) performance can achieve up to [Formula: see text] accuracy, which outperforms the common CNNs by [Formula: see text] on average. In addition, we conduct rigorous user studies to confirm that our MC-CNN outperforms experienced doctors, yet only consuming roughly [Formula: see text] ( 1/48) of doctors' examination time on average. Therefore, the accuracy and efficiency of our new method exhibit its great potential in clinical applications.

Thyroid Nodule Detection in Ultrasound Images with Convolutional Neural Networks

Multitask Cascade Convolution Neural Networks for Automatic Thyroid Nodule Detection and Recognition

Segmentation of Thyroid Glands and Nodules in Ultrasound Images Using the Improved U-Net Architecture.

Automated Detection and Classification of Thyroid Nodules in Ultrasound Images Using Clinical-Knowledge-guided Convolutional Neural Networks

Ultrasound Image-Based Thyroid Nodule Automatic Segmentation Using Convolutional Neural Networks

An Intelligent Platform for Ultrasound Diagnosis of Thyroid Nodules

Reliable Thyroid Carcinoma Detection with Real-Time Intelligent Analysis of Ultrasound Images

Research on The Identification of Benign and Malignant Thyroid Nodule Ultrasound Images Based on Deep Learning Model

A pre-trained convolutional neural network based method for thyroid nodule diagnosis.

Ultrasound Image Classification of Thyroid Nodules Based on Deep Learning

Thyroid Nodule Classification in Ultrasound Images by Fine-Tuning Deep Convolutional Neural Network

Cascade Convolutional Neural Networks for Automatic Detection of Thyroid Nodules in Ultrasound Images

Automatic Malignant Thyroid Nodule Recognition in Ultrasound Images based on Deep Learning

Thyroid ultrasound image classification using a convolutional neural network

A New Classification Method in Ultrasound Images of Benign and Malignant Thyroid Nodules Based on Transfer Learning and Deep Convolutional Neural Network

Automatic Recognition and Classification System of Thyroid Nodules in CT Images Based on CNN

Automated detection and recognition of thyroid nodules in ultrasound images using Improve Cascade Mask R-CNN

Automatic Thyroid Nodule Detection in Ultrasound Imaging With Improved YOLOv5 Neural Network

Ultrasound Image-Based Diagnosis of Malignant Thyroid Nodule Using Artificial Intelligence

Deep convolutional neural networks in thyroid disease detection: A multi-classification comparison by ultrasonography and computed tomography

Identification method of thyroid nodule ultrasonography based on self-supervised learning dual-branch attention learning framework