Antagonistic AI

Alice Cai,Ian Arawjo,Elena L. Glassman

2024-02-12

Abstract:The vast majority of discourse around AI development assumes that subservient, "moral" models aligned with "human values" are universally beneficial -- in short, that good AI is sycophantic AI. We explore the shadow of the sycophantic paradigm, a design space we term antagonistic AI: AI systems that are disagreeable, rude, interrupting, confrontational, challenging, etc. -- embedding opposite behaviors or values. Far from being "bad" or "immoral," we consider whether antagonistic AI systems may sometimes have benefits to users, such as forcing users to confront their assumptions, build resilience, or develop healthier relational boundaries. Drawing from formative explorations and a speculative design workshop where participants designed fictional AI technologies that employ antagonism, we lay out a design space for antagonistic AI, articulating potential benefits, design techniques, and methods of embedding antagonistic elements into user experience. Finally, we discuss the many ethical challenges of this space and identify three dimensions for the responsible design of antagonistic AI -- consent, context, and framing.

Human-Computer Interaction

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

The paper explores the prevalent compliant and moralized patterns in current artificial intelligence (AI) systems and proposes a design space called "adversarial AI." The authors argue that current AI systems are overly accommodating to users' needs, lacking challenge and criticality, which may lead users to rely on these systems' comfort zones, thereby failing to face real-world difficulties and challenges. Therefore, they explore an AI design paradigm opposite to the existing one—an AI system that exhibits behaviors such as unfriendliness, rudeness, and conversation interruption to force users to confront their assumptions, enhance psychological resilience, or establish healthier boundaries.

The main objectives of the paper are:
1. **Reveal the limitations of existing AI systems**: Current AI systems are overly compliant and serve users, lacking challenge, which may trap users in a false sense of security.
2. **Propose the concept of adversarial AI**: Design an AI system that can actively challenge users, making it beneficial to users in certain situations.
3. **Explore potential benefits and design techniques**: Through a series of experiments and design workshops, the authors summarize the potential benefits of adversarial AI and its design methods.
4. **Discuss ethical challenges**: Identify and discuss multiple ethical issues faced in designing adversarial AI, such as informed consent, the importance of context, and framing.

Through this research, the authors hope to spark in-depth discussions on AI ethics and design and encourage more responsible research to explore the design of adversarial AI systems.