Abstract:Responsible AI has risen to the forefront of the AI research community. As neural network-based learning algorithms continue to permeate real-world applications, the field of Responsible AI has played a large role in ensuring that such systems maintain a high-level of human-compatibility. Despite this progress, the state of the art in Responsible AI has ignored one crucial point: human problems are multi-agent problems. Predominant approaches largely consider the performance of a single AI system in isolation, but human problems are, by their very nature, multi-agent. From driving in traffic to negotiating economic policy, human problem-solving involves interaction and the interplay of the actions and motives of multiple individuals. This dissertation develops the study of responsible emergent multi-agent behavior, illustrating how researchers and practitioners can better understand and shape multi-agent learning with respect to three pillars of Responsible AI: interpretability, fairness, and robustness. First, I investigate multi-agent interpretability, presenting novel techniques for understanding emergent multi-agent behavior at multiple levels of granularity. With respect to low-level interpretability, I examine the extent to which implicit communication emerges as an aid to coordination in multi-agent populations. I introduce a novel curriculum-driven method for learning high-performing policies in difficult, sparse reward environments and show through a measure of position-based social influence that multi-agent teams that learn sophisticated coordination strategies exchange significantly more information through implicit signals than lesser-coordinated agents. Then, at a high-level, I study concept-based interpretability in the context of multi-agent learning. I propose a novel method for learning intrinsically interpretable, concept-based policies and show that it enables...

Multi-Agent Interplay in a Competitive Survival Environment

Emergent Complexity via Multi-Agent Competition

Pursuit-Evasion Games for Multi-agent Based on Reinforcement Learning with Obstacles

On Emergent Communication in Competitive Multi-Agent Teams

Multi-Agent Evolutionary Reinforcement Learning Based on Cooperative Games

Emergent Tool Use from Multi-Agent Autocurricula.

Non-cooperative Multi-agent Systems with Exploring Agents

Multi-Agent Cooperative-Competitive Environment with Reinforcement Learning

Multi-Agent Curricula and Emergent Implicit Signaling

MatrixWorld: A pursuit-evasion platform for safe multi-agent coordination and autocurricula

Multi-Agent Autonomy: Advancements and Challenges in Subterranean Exploration

Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments

Exploring Dominant Strategies in Iterated and Evolutionary Games: a Multi-Agent Reinforcement Learning Approach

Responsible Emergent Multi-Agent Behavior

Deep Reinforcement Learning for Multi-Agent Interaction

Multi-Agent Large Language Models for Conversational Task-Solving

MAESTRO: Open-Ended Environment Design for Multi-Agent Reinforcement Learning

Understanding Emergent Behaviours in Multi-Agent Systems with Evolutionary Game Theory

Multi-Agent Deep Reinforcement Learning with Human Strategies

Finding Friend and Foe in Multi-Agent Games

Emergent Solutions to High-Dimensional Multitask Reinforcement Learning