Abstract:PROBLEM:Ultrasonography is recommended as the first choice for evaluation of thyroid nodules, however, conventional ultrasound features may not be able to adequately predict malignancy. Ultrasound elastography, adjunct to conventional B-mode ultrasound, can effectively improve the diagnostic accuracy of thyroid nodules. However, this technology requires professional elastography equipment and experienced physicians.AIM:in the field of computational medicine, Generative Adversarial Networks (GANs) were proven to be a powerful tool for generating high-quality images. This work therefore utilizes GANs to generate ultrasound elastography images.METHODS:this paper proposes a new automated generation method of ultrasound elastography (AUE-net) to generate elastography images from conventional ultrasound images. The AUE-net was based on the U-Net architecture and optimized by attention modules and feature residual blocks, which could improve the adaptability of feature extraction for nodules of different sizes. The additional color loss function was used to balance color distribution. In this network, we first attempted to extract the tissue features of the ultrasound image in the latent space, then converted the attributes by modeling the strain, and finally reconstructed them into the corresponding elastography image.RESULTS:a total of 726 thyroid ultrasound elastography images with corresponding conventional images from 397 patients were obtained between 2019 and 2021 as the dataset (646 in training set and 80 in testing set). The mean rating accuracy of the AUE-net generated elastography images by ultrasound specialists was 84.38%. Compared with that of the existing models in the visual aspect, the presented model generated relatively higher quality elastography images.CONCLUSION:the AUE-net generated ultrasound elastography images showed natural appearance and retained tissue information. Accordingly, it seems that B-mode ultrasound harbors information that can link to tissue elasticity. This study may pave the way to generate ultrasound elastography images readily without the need for professional equipment.

Data Augmentation of Thyroid Ultrasound Images Using Generative Adversarial Network

Enhanced CT Image Generation by GAN for Improving Thyroid Anatomy Detection.

AUE-Net: Automated Generation of Ultrasound Elastography Using Generative Adversarial Network.

Knowledge-guided Synthetic Medical Image Adversarial Augmentation for Ultrasonography Thyroid Nodule Classification

Generating synthetic medical images with limited data using auxiliary classifier generative adversarial network: a study on thyroid ultrasound images

GSDA: Generative Adversarial Network-based Semi-Supervised Data Augmentation for Ultrasound Image Classification

Generative Adversarial U-Net for Domain-free Medical Image Augmentation

CT-realistic Data Augmentation Using Generative Adversarial Network for Robust Lymph Node Segmentation.

Data Augmentation For Medical MR Image Using Generative Adversarial Networks

Semantic Consistency Generative Adversarial Network for Cross-Modality Domain Adaptation in Ultrasound Thyroid Nodule Classification

Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesis

U2F-GAN: Weakly Supervised Super-pixel Segmentation in Thyroid Ultrasound Images

Generative Adversarial Networks for Data Augmentation

GANs for generation of synthetic ultrasound images from small datasets

Toward Smart Ultrasound Image Augmentation to Advance Tumor Treatment Monitoring: Exploring the Potential of Diffusion Generative Model

Medical Image Synthesis for Data Augmentation and Anonymization using Generative Adversarial Networks

Echocardiography Segmentation Based on Cross-modal Data Augmentation Method

GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks

A U-Net Based Progressive GAN for Microscopic Image Augmentation

Data Augmentation for Cardiac Magnetic Resonance Image Using Evolutionary GAN

Medical Image Generation Techniques for Data Augmentation: Disc-VAE versus GAN