Abstract:Multi-agent reinforcement learning (MARL) is a prevalent learning paradigm for solving stochastic games. In most MARL studies, agents in a game are defined as teammates or enemies beforehand, and the relationships among the agents (i.e., their identities ) remain fixed throughout the game. However, in real-world problems, the agent relationships are commonly unknown in advance or dynamically changing. Many multi-party interactions start off by asking: who is on my team? This question arises whether it is the first day at the stock exchange or the kindergarten. Therefore, training policies for such situations in the face of imperfect information and ambiguous identities is an important problem that needs to be addressed. In this work, we develop a novel identity detection reinforcement learning (IDRL) framework that allows an agent to dynamically infer the identities of nearby agents and select an appropriate policy to accomplish the task. In the IDRL framework, a relation network is constructed to deduce the identities of other agents by observing the behaviors of the agents. A danger network is optimized to estimate the risk of false-positive identifications. Beyond that, we propose an intrinsic reward that balances the need to maximize external rewards and accurate identification. After identifying the cooperation-competition pattern among the agents, IDRL applies one of the off-the-shelf MARL methods to learn the policy. To evaluate the proposed method, we conduct experiments on Red-10 card-shedding game, and the results show that IDRL achieves superior performance over other state-of-the-art MARL methods. Impressively, the relation network has the par performance to identify the identities of agents with top human players; the danger network reasonably avoids the risk of imperfect identification. The code to reproduce all the reported results is available online at https://github.com/MR-BENjie/IDRL.

Referent Misidentification and Recovery among Communicating Agents

Resilient Consensus with Mobile Detectors Against Malicious Attacks

Dissociation of understanding from applying others’ false beliefs in remitted schizophrenia: evidence from a computerized referential communication task

Description-Based Communication For Autonomous Agents Under Ideal Conditions

Failure recovery mechanism for BDI agents based on abilities and discovery protocols

Inconsistency Resolution Method for RBAC Based Interoperation

Who Stole My Cheese?: Verifying Intactness of Anonymous RFID Systems

Classifying ambiguous identities in hidden-role Stochastic games with multi-agent reinforcement learning

A Trust Management and Misbehaviour Detection Mechanism for Multi-Agent Systems and its Application to Intelligent Transportation Systems

Multiagent Inverse Reinforcement Learning via Theory of Mind Reasoning

Rel-A.I.: An Interaction-Centered Approach To Measuring Human-LM Reliance

RMIO: A Model-Based MARL Framework for Scenarios with Observation Loss in Some Agents

Trust-based Consensus in Multi-Agent Reinforcement Learning Systems

Reinforcement Learning-Based MAS Interception in Antagonistic Environments

Resilient Distributed Control in the Presence of Misbehaving Agents in Networked Control Systems.

Identification of Unmodeled Objects from Symbolic Descriptions

Recover: A Neuro-Symbolic Framework for Failure Detection and Recovery

H₂ Resilient Consensus Control of Multiagent Systems under Deception Attack.

RSSI-based Localization with Adaptive Noise Covariance Estimation for Resilient Multi-Agent Formations

Domain-Independent Deception: A New Taxonomy and Linguistic Analysis

On Imperfect Recall in Multi-Agent Influence Diagrams