Abstract:Generative Adversarial Networks (GANs) are a revolutionary class of Deep Neural Networks (DNNs) that have been successfully used to generate realistic images, music, text, and other data. However, GAN training presents many challenges, notably it can be very resource-intensive. A potential weakness in GANs is that it requires a lot of data for successful training and data collection can be an expensive process. Typically, the corrective feedback from discriminator DNNs to generator DNNs (namely, the discriminator's assessment of the generated example) is calculated using only one real-numbered value (loss). By contrast, we propose a new class of GAN we refer to as xAI-GAN that leverages recent advances in explainable AI (xAI) systems to provide a "richer" form of corrective feedback from discriminators to generators. Specifically, we modify the gradient descent process using xAI systems that specify the reason as to why the discriminator made the classification it did, thus providing the "richer" corrective feedback that helps the generator to better fool the discriminator. Using our approach, we observe xAI-GANs provide an improvement of up to 23.18% in the quality of generated images on both MNIST and FMNIST datasets over standard GANs as measured by Frechet Inception Distance (FID). We further compare xAI-GAN trained on 20% of the data with standard GAN trained on 100% of data on the CIFAR10 dataset and find that xAI-GAN still shows an improvement in FID score. Further, we compare our work with Differentiable Augmentation - which has been shown to make GANs data-efficient - and show that xAI-GANs outperform GANs trained on Differentiable Augmentation. Moreover, both techniques can be combined to produce even better results. Finally, we argue that xAI-GAN enables users greater control over how models learn than standard GANs.

Enhancing Interpretability in AI-Generated Image Detection with Genetic Programming

No One Can Escape: A General Approach to Detect Tampered and Generated Image

Improving Interpretability and Robustness for the Detection of AI-Generated Images

Explainable Artificial Intelligence by Genetic Programming: A Survey

RealtimeGen: an Intervenable AI Image Generation System for Commercial Digital Art Asset Creators

A Sanity Check for AI-generated Image Detection

SemGIR: Semantic-Guided Image Regeneration Based Method for AI-generated Image Detection and Attribution

AI-Generated Image Detection using a Cross-Attention Enhanced Dual-Stream Network

xAI-GAN: Enhancing Generative Adversarial Networks via Explainable AI Systems

Assessing AI Detectors in Identifying AI-Generated Code: Implications for Education

Evaluating AIGC Detectors on Code Content

Genetic Programming With Flexible Region Detection for Fine-Grained Image Classification

AI vs. AI: Can AI Detect AI-Generated Images?

GAN Doctor: Diagnosing and Treating Inherent Semantic Errors

Detecting AI-Generated Images via CLIP

A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT

Detecting Generated Images by Real Images Only

PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detection

Application of Generative Artificial Intelligence AIGC Technology Under Neural Network Algorithm in Game Character Art Design

GenImage: A Million-Scale Benchmark for Detecting AI-Generated Image

Fake It Until You Break It: On the Adversarial Robustness of AI-generated Image Detectors