Adversarial-learning-based image-to-image transformation: A survey

Yuan Chen,Yang Zhao,Wei Jia,Li Cao,Xiaoping Liu
DOI: https://doi.org/10.1016/j.neucom.2020.06.067
IF: 6
2020-10-01
Neurocomputing
Abstract:<p>Recently, the generative adversarial network (GAN) has attracted wide attention for various computer vision tasks. GAN provides a novel concept for image-to-image transformation by means of adversarial learning. In recent years, numerous adversarial-learning-based methods have been proposed, and impressive results have been achieved. Related reviews have mainly focused on the basic GAN model and its general variants; in contrast, this survey aims to provide an overview of adversarial-learning-based methods by focusing on the image-to-image transformation scenario. First, a brief review of basic GAN is presented; next, the related approaches are roughly divided into adversarial style transfer and adversarial image restoration, <em>e.g.</em>, super-resolution, image inpainting, and de-raining The network architectures of generative models and loss functions are introduced and discussed in detail. Finally, we conclude the survey with an analysis of the trends and challenges.</p>
computer science, artificial intelligence
What problem does this paper attempt to address?
This paper aims to solve the problem of reviewing the application of Generative Adversarial Networks (GANs) in image - to - image translation tasks. Specifically, the paper focuses on the application of adversarial - learning - based methods in two main areas: image style transfer and image restoration/reconstruction. The paper attempts to provide a comprehensive perspective for relevant research by reviewing the existing methods in these areas, discussing their network architectures, the design of loss functions, and analyzing the current development trends and challenges faced. The paper mentions that although the existing review literature on GANs mainly focuses on the basic GAN model and its general variants, this paper specifically focuses on this particular application scenario of image - to - image translation. In this way, the paper hopes to fill the gap in the existing review literature's insufficient coverage in this particular area and provide researchers with more targeted and in - depth understanding.