Copy-Paste Image Augmentation with Poisson Image Editing for Ultrasound Instance Segmentation Learning

Wei-Hsiang Shen,Meng-Lin Li
2023-08-28
Abstract:Deep learning has shown great success in high-level image analysis problems; yet its efficacy relies on the quality and diversity of the training data. In this work, we introduce a copypaste image augmentation for ultrasound images. The Poisson image editing technique is used to generate realistic and seamless boundary transitions around the pasted image. Results showed that the proposed image augmentation technique improves training performance in terms of higher objective metrics and more stable training results.
Image and Video Processing
What problem does this paper attempt to address?
The problem this paper attempts to address is: In the task of ultrasound image instance segmentation, how to improve the performance of deep learning models by enhancing the quality and diversity of training data. Specifically, the authors point out that although deep learning has achieved great success in advanced image analysis problems, its effectiveness is highly dependent on the quality and diversity of the training data. For ultrasound images, collecting clinical data is challenging, and annotating this data requires expertise and is time-consuming. Additionally, the collected data may lack sufficient diversity, limiting the model's generalization ability in different clinical cases. To address these issues, the authors propose a new image augmentation method based on "copy-paste," utilizing Poisson image editing to generate realistic training samples with seamless boundary transitions. Compared to traditional copy-paste methods, this approach can avoid introducing artificial boundaries in ultrasound images, thereby improving training performance. Experimental results show that this method not only generates realistic samples but also significantly enhances the model's performance and training stability.