Abstract:During thyroid ultrasound diagnosis, radiologists add markers such as pluses or crosses near a nodule's edge to indicate the location of a nodule. For computer-aided detection, deep learning models achieve classification, segmentation, and detection by learning the thyroid's texture in ultrasound images. Experiments show that manual markers are strong prior knowledge for data-driven deep learning models, which interferes with the judgment mechanism of computer-aided detection systems. Aiming at this problem, this paper proposes cascade marker removal algorithm for thyroid ultrasound images to eliminate the interference of manual markers. The algorithm consists of three parts. First, in order to highlight marked features, the algorithm extracts salient features in thyroid ultrasound images through feature extraction module. Secondly, mask correction module eliminates the interference of other features besides markers' features. Finally, the marker removal module removes markers without destroying the semantic information in thyroid ultrasound images. Experiments show that our algorithm enables classification, segmentation, and object detection models to focus on the learning of pathological tissue features. At the same time, compared with mainstream image inpainting algorithms, our algorithm shows better performance on thyroid ultrasound images. In summary, our algorithm is of great significance for improving the stability and performance of computer-aided detection systems. Graphical Abstract During thyroid ultrasound diagnosis, doctors add markers such as pluses or crosses near nodule's edge to indicate the location of nodule. Manual markers are strong prior knowledge for data-driven deep learning models, which interferes the judgment mechanism of computer-aided diagnosis system based on deep learning. Markers make models overfit the specific labeling forms easily, and performs poorly on unmarked thyroid ultrasound images. Aiming at this problem, this paper proposes a cascade marker removal algorithm to eliminate the interference of manual markers. Our algorithm make deep learning models pay attention on nodules' features of thyroid ultrasound images, which make computer-aided diagnosis system performs good in both marked imaging and unmarked imaging.

Blind Image Inpainting Using Pyramid GAN on Thyroid Ultrasound Images.

Pyramid-VAE-GAN: Transferring Hierarchical Latent Variables for Image Inpainting

Preliminary study on thyroid ultrasound image restoration algorithm based on deep learning

Face Image Inpainting Based on Generative Adversarial Network

Texture Synthesis Based Thyroid Nodule Detection from Medical Ultrasound Images: Interpreting and Suppressing the Adversarial Effect of In-place Manual Annotation

Structure First Detail Next: Image Inpainting with Pyramid Generator

Blind Inpainting with Object-aware Discrimination for Artificial Marker Removal

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

Cascade marker removal algorithm for thyroid ultrasound images

High-Resolution Image Inpainting Through Multiple Deep Networks

Generator Pyramid for High-Resolution Image Inpainting

GAN-Guided Deformable Attention Network for Identifying Thyroid Nodules in Ultrasound Images

Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting

U2F-GAN: Weakly Supervised Super-pixel Segmentation in Thyroid Ultrasound Images

Thyroid Ultrasound Image Database and Marker Mask Inpainting Method for Research and Development

Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesis

Deep Attentional GAN-based High-Resolution Ultrasound Imaging

Deep Blind Image Inpainting

High-resolution Image Reconstruction for Portable Ultrasound Imaging Devices

ENHANCED SHARP-GAN FOR HISTOPATHOLOGY IMAGE SYNTHESIS

Contextual Attention Mechanism, SRGAN Based Inpainting System for Eliminating Interruptions from Images