Abstract:Generative Adversarial Networks (GANs) are a revolutionary class of Deep Neural Networks (DNNs) that have been successfully used to generate realistic images, music, text, and other data. However, GAN training presents many challenges, notably it can be very resource-intensive. A potential weakness in GANs is that it requires a lot of data for successful training and data collection can be an expensive process. Typically, the corrective feedback from discriminator DNNs to generator DNNs (namely, the discriminator's assessment of the generated example) is calculated using only one real-numbered value (loss). By contrast, we propose a new class of GAN we refer to as xAI-GAN that leverages recent advances in explainable AI (xAI) systems to provide a "richer" form of corrective feedback from discriminators to generators. Specifically, we modify the gradient descent process using xAI systems that specify the reason as to why the discriminator made the classification it did, thus providing the "richer" corrective feedback that helps the generator to better fool the discriminator. Using our approach, we observe xAI-GANs provide an improvement of up to 23.18% in the quality of generated images on both MNIST and FMNIST datasets over standard GANs as measured by Frechet Inception Distance (FID). We further compare xAI-GAN trained on 20% of the data with standard GAN trained on 100% of data on the CIFAR10 dataset and find that xAI-GAN still shows an improvement in FID score. Further, we compare our work with Differentiable Augmentation - which has been shown to make GANs data-efficient - and show that xAI-GANs outperform GANs trained on Differentiable Augmentation. Moreover, both techniques can be combined to produce even better results. Finally, we argue that xAI-GAN enables users greater control over how models learn than standard GANs.

Variational MineGAN: A Data-efficient Knowledge Transfer Architecture for Generative AI-assisted Design of Nanophotonic Structures

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

SpatialGAN: Progressive Image Generation Based on Spatial Recursive Adversarial Expansion

xAI-GAN: Enhancing Generative Adversarial Networks via Explainable AI Systems

CreativeGAN: Editing Generative Adversarial Networks for Creative Design Synthesis

Generative adversarial networks (GANs): Introduction, Taxonomy, Variants, Limitations, and Applications

A brief study of generative adversarial networks and their applications in image synthesis

Are Generative Adversarial Networks Capable Of Generating Novel And Diverse Design Concepts? An Experimental Analysis Of Performance

Comprehensive Overview of GAN Technology: Architecture, Training, and Applications

Generative Deep Learning in Architectural Design

Survey of Quantum Generative Adversarial Networks (QGAN) to Generate Images

Variational Quantum Circuits Enhanced Generative Adversarial Network

Survey on Generative Adversarial Behavior in Artificial Neural Tasks

A Survey of Modern Deep Learning based Generative Adversarial Networks (GANs)

Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Data

A Variational Autoencoder Cascade Generative Adversarial Network for Scalable 3D Object Generation and Reconstruction

DA-VEGAN: Differentiably Augmenting VAE-GAN for microstructure reconstruction from extremely small data sets

Generative Adversarial Network Applications in Industry 4.0: A Review

A Novel Generator With Auxiliary Branch for Improving GAN Performance

Systematic Analysis of Image Generation using GANs