Abstract:Existing generative adversarial network (GAN) based conditional imagegenerative models typically produce fixed output for the same conditionalinput, which is unreasonable for highly subjective tasks, such as large-maskimage inpainting or style transfer. On the other hand, GAN-based diverse imagegenerative methods require retraining/fine-tuning the network or designingcomplex noise injection functions, which is computationally expensive,task-specific, or struggle to generate high-quality results. Given that manydeterministic conditional image generative models have been able to producehigh-quality yet fixed results, we raise an intriguing question: is it possiblefor pre-trained deterministic conditional image generative models to generatediverse results without changing network structures or parameters? To answerthis question, we re-examine the conditional image generation tasks from theperspective of adversarial attack and propose a simple and efficient plug-inprojected gradient descent (PGD) like method for diverse and controllable imagegeneration. The key idea is attacking the pre-trained deterministic generativemodels by adding a micro perturbation to the input condition. In this way,diverse results can be generated without any adjustment of network structuresor fine-tuning of the pre-trained models. In addition, we can also control thediverse results to be generated by specifying the attack direction according toa reference text or image. Our work opens the door to applying adversarialattack to low-level vision tasks, and experiments on various conditional imagegeneration tasks demonstrate the effectiveness and superiority of the proposedmethod.

Procedural Content Generation of Puzzle Games using Conditional Generative Adversarial Networks

An Interactive Evolution Strategy Based Deep Convolutional Generative Adversarial Network for 2D Video Game Level Procedural Content Generation

Attack Deterministic Conditional Image Generative Models for Diverse and Controllable Generation

Learning to Generate Levels From Nothing

Generative Creativity: Adversarial Learning For Bionic Design

Evolving Mario Levels in the Latent Space of a Deep Convolutional Generative Adversarial Network

JigsawGAN: Auxiliary Learning for Solving Jigsaw Puzzles with Generative Adversarial Networks

Utilizing Generative Adversarial Networks for Stable Structure Generation in Angry Birds

JigsawGAN: Self-supervised Learning for Solving Jigsaw Puzzles with Generative Adversarial Networks.

Bootstrapping Conditional GANs for Video Game Level Generation

Automated Graph Genetic Algorithm based Puzzle Validation for Faster Game Design

Improving Conditional Level Generation using Automated Validation in Match-3 Games

PCGPT: Procedural Content Generation via Transformers

Procedural Content Generation via Machine Learning (PCGML)

PCGRL: Procedural Content Generation via Reinforcement Learning

Co-generation of game levels and game-playing agents

Puzzle-Level Generation with Simple-tiled and Graph-based Wave Function Collapse Algorithms

GAN-Based Content Generation of Maps for Strategy Games

Procedural Level Generation with Diffusion Models from a Single Example

Using Genetic Algorithm to Solve Puzzle Games: A Review

Adversarial Reinforcement Learning for Procedural Content Generation