Abstract:Diagnostic results can be radically influenced by the quality of 2D ovarian-tumor ultrasound images. However, clinically processed 2D ovarian-tumor ultrasound images contain many artificially recognized symbols, such as fingers, crosses, dashed lines, and letters which assist artificial intelligence (AI) in image recognition. These symbols are widely distributed within the lesion’s boundary, which can also affect the useful feature-extraction-utilizing networks and thus decrease the accuracy of lesion classification and segmentation. Image inpainting techniques are used for noise and object elimination from images. To solve this problem, we observed the MMOTU dataset and built a 2D ovarian-tumor ultrasound image inpainting dataset by finely annotating the various symbols in the images. A novel framework called mask-guided generative adversarial network (MGGAN) is presented in this paper for 2D ovarian-tumor ultrasound images to remove various symbols from the images. The MGGAN performs to a high standard in corrupted regions by using an attention mechanism in the generator to pay more attention to valid information and ignore symbol information, making lesion boundaries more realistic. Moreover, fast Fourier convolutions (FFCs) and residual networks are used to increase the global field of perception; thus, our model can be applied to high-resolution ultrasound images. The greatest benefit of this algorithm is that it achieves pixel-level inpainting of distorted regions without clean images. Compared with other models, our model achieveed better results with only one stage in terms of objective and subjective evaluations. Our model obtained the best results for 256 × 256 and 512 × 512 resolutions. At a resolution of 256 × 256, our model achieved 0.9246 for SSIM, 22.66 for FID, and 0.07806 for LPIPS. At a resolution of 512 × 512, our model achieved 0.9208 for SSIM, 25.52 for FID, and 0.08300 for LPIPS. Our method can considerably improve the accuracy of computerized ovarian tumor diagnosis. The segmentation accuracy was improved from 71.51% to 76.06% for the Unet model and from 61.13% to 66.65% for the PSPnet model in clean images.

Generative Adversarial Network Using Multi-modal Guidance for Ultrasound Images Inpainting.

UCTGAN: Diverse Image Inpainting Based on Unsupervised Cross-Space Translation

Face Image Inpainting Based on Generative Adversarial Network

MMGInpainting: Multi-Modality Guided Image Inpainting Based On Diffusion Models

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

Multi-Scale Generative Adversarial Networks Image Inpainting Algorithm*

Image Inpainting Based on Double Joint Predictive Filtering and Wasserstein Generative Adversarial Networks.

Sketch guided and progressive growing GAN for realistic and editable ultrasound image synthesis

Multi-scale Generative Adversarial Network with Multi-Head External Attention for Image Inpainting

Blind Image Inpainting Using Pyramid GAN on Thyroid Ultrasound Images.

Unbiased Multi-Modality Guidance for Image Inpainting

Image Inpainting Using Block-wise Procedural Training with Annealed Adversarial Counterpart.

Image Fine-grained Inpainting.

Improving the Segmentation Accuracy of Ovarian-Tumor Ultrasound Images Using Image Inpainting

A Prior-Guided Generative Adversarial Net for Semantically Strict Ultrasound Images Augmentation.

SkrGAN: Sketching-rendering Unconditional Generative Adversarial Networks for Medical Image Synthesis

Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model

High-Resolution Image Inpainting Based On Multi-Scale Neural Network

Attentional coarse-and-fine generative adversarial networks for image inpainting

Multimodal MR Image Synthesis Using Gradient Prior and Adversarial Learning

Text-Guided Co-Modulated Generative Adversarial Network for Image Inpainting