Active Divergence with Generative Deep Learning -- A Survey and Taxonomy

Terence Broad,Sebastian Berns,Simon Colton,Mick Grierson

DOI: https://doi.org/10.48550/arXiv.2107.05599

2021-07-13

Abstract:Generative deep learning systems offer powerful tools for artefact generation, given their ability to model distributions of data and generate high-fidelity results. In the context of computational creativity, however, a major shortcoming is that they are unable to explicitly diverge from the training data in creative ways and are limited to fitting the target data distribution. To address these limitations, there have been a growing number of approaches for optimising, hacking and rewriting these models in order to actively diverge from the training data. We present a taxonomy and comprehensive survey of the state of the art of active divergence techniques, highlighting the potential for computational creativity researchers to advance these methods and use deep generative models in truly creative systems.

Machine Learning,Artificial Intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is in generative deep - learning systems, how to enable these systems to actively deviate from the training data in a creative way, rather than just fitting the target data distribution. Specifically, although generative deep - learning methods are very powerful in generating high - quality artifacts, one of their major drawbacks is the inability to explicitly deviate creatively from the training data, which limits their application in the field of computational creativity. To overcome this limitation, researchers have developed a series of methods to optimize, hack or rewrite these models to achieve active deviation from the training data. By providing a comprehensive survey and classification of these methods, the paper aims to highlight how computational creativity researchers can advance these techniques and use deep - generation models to build truly creative systems.