Abstract:Thyroid ultrasonography is a widely used clinical technique for nodule diagnosis in thyroid regions. However, it remains difficult to detect and recognize the nodules due to low contrast, high noise, and diverse appearance of nodules. In today's clinical practice, senior doctors could pinpoint nodules by analyzing global context features, local geometry structure, and intensity changes, which would require rich clinical experience accumulated from hundreds and thousands of nodule case studies. To alleviate doctors' tremendous labor in the diagnosis procedure, we advocate a machine learning approach to the detection and recognition tasks in this paper. In particular, we develop a multitask cascade convolution neural network (MC-CNN) framework to exploit the context information of thyroid nodules. It may be noted that our framework is built upon a large number of clinically confirmed thyroid ultrasound images with accurate and detailed ground truth labels. Other key advantages of our framework result from a multitask cascade architecture, two stages of carefully designed deep convolution networks in order to detect and recognize thyroid nodules in a pyramidal fashion, and capturing various intrinsic features in a global-to-local way. Within our framework, the potential regions of interest after initial detection are further fed to the spatial pyramid augmented CNNs to embed multiscale discriminative information for fine-grained thyroid recognition. Experimental results on 4309 clinical ultrasound images have indicated that our MC-CNN is accurate and effective for both thyroid nodules detection and recognition. For the correct diagnosis rate of malignant and benign thyroid nodules, its mean Average Precision (mAP) performance can achieve up to [Formula: see text] accuracy, which outperforms the common CNNs by [Formula: see text] on average. In addition, we conduct rigorous user studies to confirm that our MC-CNN outperforms experienced doctors, yet only consuming roughly [Formula: see text] ( 1/48) of doctors' examination time on average. Therefore, the accuracy and efficiency of our new method exhibit its great potential in clinical applications.

Ensemble of Multiscale Fine-Tuning Convolutional Neural Networks for Recognition of Benign and Malignant Thyroid Nodules

Diagnosis of Thyroid Nodules in Ultrasound Images Using Two Combined Classification Modules

Multitask Cascade Convolution Neural Networks for Automatic Thyroid Nodule Detection and Recognition

Predicting Malignancy and Benign Thyroid Nodule Using Multi-Scale Feature Fusion and Deep Learning

Thyroid Nodule Classification in Ultrasound Images by Fine-Tuning Deep Convolutional Neural Network

Ensemble Deep Learning Model for Multicenter Classification of Thyroid Nodules on Ultrasound Images

A New Classification Method in Ultrasound Images of Benign and Malignant Thyroid Nodules Based on Transfer Learning and Deep Convolutional Neural Network

A segmentation-based algorithm for classification of benign and malignancy Thyroid nodules with multi-feature information

Tnc-Net: Automatic Classification for Thyroid Nodules Lesions Using Convolutional Neural Network

A multi-task model for reliable classification of thyroid nodules in ultrasound images

GAN-Guided Deformable Attention Network for Identifying Thyroid Nodules in Ultrasound Images

Automatic Recognition and Classification System of Thyroid Nodules in CT Images Based on CNN

A pre-trained convolutional neural network based method for thyroid nodule diagnosis.

Automatic Malignant Thyroid Nodule Recognition in Ultrasound Images based on Deep Learning

A Novel Ultrasound Image Diagnostic Method for Thyroid Nodules

Automated detection and recognition of thyroid nodules in ultrasound images using Improve Cascade Mask R-CNN

An Intelligent Platform for Ultrasound Diagnosis of Thyroid Nodules

Thyroid Nodule Detection in Ultrasound Images with Convolutional Neural Networks

A Local and Global Feature Disentangled Network: Toward Classification of Benign-malignant Thyroid Nodules from Ultrasound Image

Automatic Classification of Thyroid Nodules in Ultrasound Images Using a Multi-Task Attention Network Guided by Clinical Knowledge

A Novel Ultrasound Image Diagnosis Method for Thyroid Nodules