Towards a Harms Taxonomy of AI Likeness Generation

Ben Bariach,Bernie Hogan,Keegan McBride
2024-06-30
Abstract:Generative artificial intelligence models, when trained on a sufficient number of a person's images, can replicate their identifying features in a photorealistic manner. We refer to this process as 'likeness generation'. Likeness-featuring synthetic outputs often present a person's likeness without their control or consent, and may lead to harmful consequences. This paper explores philosophical and policy issues surrounding generated likeness. It begins by offering a conceptual framework for understanding likeness generation by examining the novel capabilities introduced by generative systems. The paper then establishes a definition of likeness by tracing its historical development in legal literature. Building on this foundation, we present a taxonomy of harms associated with generated likeness, derived from a comprehensive meta-analysis of relevant literature. This taxonomy categorises harms into seven distinct groups, unified by shared characteristics. Utilising this taxonomy, we raise various considerations that need to be addressed for the deployment of appropriate mitigations. Given the multitude of stakeholders involved in both the creation and distribution of likeness, we introduce concepts such as indexical sufficiency, a distinction between generation and distribution, and harms as having a context-specific nature. This work aims to serve industry, policymakers, and future academic researchers in their efforts to address the societal challenges posed by likeness generation.
Computers and Society
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the social and legal challenges brought about by generative artificial intelligence (AI) models replicating personal portraits (i.e., "portrait generation") in image generation. Specifically, the paper explores the following issues: 1. **What is portrait generation**: The paper first defines the concept of "portrait generation", that is, by training a large number of images of a specific individual, the generative AI model can reproduce the characteristics of that individual in a photo - realistic manner. 2. **The harms caused by portrait generation**: The paper analyzes in detail the various harms that portrait generation may cause to individuals and society, including but not limited to reputation damage, sexual assault, the harm of child sexual abuse images (CSAI), and security threats, etc. 3. **How to mitigate these harms**: Based on the above analysis, the paper proposes several aspects that need to be considered to mitigate these harms, including measures at the technical, policy, and legal levels. ### Main contributions of the paper - **Conceptual framework**: The paper provides a conceptual framework for understanding portrait generation and explores the new capabilities introduced by the generative system. - **Historical background**: By reviewing relevant cases in legal literature, the paper establishes the definition of "portrait". - **Harm classification**: Through comprehensive analysis of multidisciplinary literature, the paper proposes a classification system for the harms of portrait generation, dividing them into seven categories and describing in detail the characteristics of each type of harm. - **Consideration factors**: The paper proposes four key consideration factors to help make decisions in the future development and deployment of relevant mitigation measures. ### Background and motivation With the development of generative AI models, especially the emergence of diffusion models, these models can generate portraits of specific individuals in a highly realistic manner. This ability makes portrait generation a new social phenomenon, but it also raises many ethical and legal issues. For example, unauthorized portrait generation may lead to the invasion of an individual's privacy and even more serious consequences, such as reputation damage, sexual harassment, etc. ### Conclusion The paper aims to provide a comprehensive framework for the industry, policy - makers, and future academic researchers to address the social challenges brought about by portrait generation. By clarifying the concept of portrait generation, identifying its potential harms, and proposing corresponding mitigation measures, the paper hopes to promote the responsible use of this emerging technology by all sectors of society.