GIU-GANs: Global Information Utilization for Generative Adversarial Networks

Yongqi Tian,Xueyuan Gong,Jialin Tang,Binghua Su,Xiaoxiang Liu,Xinyuan Zhang
DOI: https://doi.org/10.48550/arXiv.2201.10471
2022-03-15
Abstract:In recent years, with the rapid development of artificial intelligence, image generation based on deep learning has dramatically advanced. Image generation based on Generative Adversarial Networks (GANs) is a promising study. However, since convolutions are limited by spatial-agnostic and channel-specific, features extracted by traditional GANs based on convolution are constrained. Therefore, GANs are unable to capture any more details per image. On the other hand, straightforwardly stacking of convolutions causes too many parameters and layers in GANs, which will lead to a high risk of overfitting. To overcome the aforementioned limitations, in this paper, we propose a new GANs called Involution Generative Adversarial Networks (GIU-GANs). GIU-GANs leverages a brand new module called the Global Information Utilization (GIU) module, which integrates Squeeze-and-Excitation Networks (SENet) and involution to focus on global information by channel attention mechanism, leading to a higher quality of generated images. Meanwhile, Batch Normalization(BN) inevitably ignores the representation differences among noise sampled by the generator, and thus degrade the generated image quality. Thus we introduce Representative Batch Normalization(RBN) to the GANs architecture for this issue. The CIFAR-10 and CelebA datasets are employed to demonstrate the effectiveness of our proposed model. A large number of experiments prove that our model achieves state-of-the-art competitive performance.
Machine Learning
What problem does this paper attempt to address?
The main problem that this paper attempts to solve lies in the limitations of existing convolutional neural network (CNN) - based generative adversarial networks (GANs) in image generation tasks. Specifically, these problems include: 1. **Spatial - independence and channel - specificity**: Traditional convolution operations are restricted by spatial - independence and channel - specificity, making it difficult for the model to capture global information and in - depth details in the image. 2. **Excessive parameters and over - fitting risk**: Directly stacking convolutional layers will lead to too many parameters and layers in GANs, increasing the risk of over - fitting, thus affecting the quality of the generated image. 3. **Problems with batch normalization (BN)**: BN will ignore the representation differences between the generator - sampled noises, thereby reducing the quality of the generated image. To solve the above problems, the author proposes GIU - GANs (Global Information Utilization for GANs) and introduces a new module - the GIU module. The GIU module combines the Squeeze - and - Excitation (SE) module and the involution operation, focuses on global information through the channel - attention mechanism, and enhances the quality of the generated image. In addition, the author also introduces representative batch normalization (RBN) to improve BN in the generator, in order to better handle the representation differences of different noises and further improve the quality of the generated image. ### Summary of main contributions: - **Designed a new GIU module**: This module uses global information to improve the GAN's feature extraction ability, thereby enhancing the quality of the generated image. - **Introduced RBN**: Makes GAN pay more attention to the expression of representative features and improves the quality of the generated image. - **Adopted two techniques**: Spectral normalization and WGAN - GP, to stabilize GAN training and improve the quality of the generated image. These improvements make GIU - GANs perform better than many classic GAN models on the CIFAR - 10 and CelebA datasets.