Generative Adversarial Networks (GANs Survey): Challenges, Solutions, and Future Directions

Divya Saxena,Jiannong Cao
DOI: https://doi.org/10.48550/arXiv.2005.00065
2023-04-05
Abstract:Generative Adversarial Networks (GANs) is a novel class of deep generative models which has recently gained significant attention. GANs learns complex and high-dimensional distributions implicitly over images, audio, and data. However, there exists major challenges in training of GANs, i.e., mode collapse, non-convergence and instability, due to inappropriate design of network architecture, use of objective function and selection of optimization algorithm. Recently, to address these challenges, several solutions for better design and optimization of GANs have been investigated based on techniques of re-engineered network architectures, new objective functions and alternative optimization algorithms. To the best of our knowledge, there is no existing survey that has particularly focused on broad and systematic developments of these solutions. In this study, we perform a comprehensive survey of the advancements in GANs design and optimization solutions proposed to handle GANs challenges. We first identify key research issues within each design and optimization technique and then propose a new taxonomy to structure solutions by key research issues. In accordance with the taxonomy, we provide a detailed discussion on different GANs variants proposed within each solution and their relationships. Finally, based on the insights gained, we present the promising research directions in this rapidly growing field.
Machine Learning,Image and Video Processing
What problem does this paper attempt to address?
The main problems that this paper attempts to solve are the significant challenges encountered in the training process of Generative Adversarial Networks (GANs), specifically including mode collapse, non - convergence, and instability. These problems mainly stem from improper network architecture design, improper use of objective functions, and improper selection of optimization algorithms. The paper points out that in order to overcome these challenges, researchers have proposed a variety of solutions based on redesigned network architectures, new objective functions, and alternative optimization algorithms. In addition, the paper also proposes a new taxonomy to structure these solutions and conducts a detailed description and systematic analysis of different types of GAN variants and their relationships. Through these methods, the paper aims to provide a comprehensive framework for researchers new to this field to better understand and develop GAN technology.