Abstract:Multi-agent reinforcement learning (MARL) is a prevalent learning paradigm for solving stochastic games. In most MARL studies, agents in a game are defined as teammates or enemies beforehand, and the relationships among the agents (i.e., their identities ) remain fixed throughout the game. However, in real-world problems, the agent relationships are commonly unknown in advance or dynamically changing. Many multi-party interactions start off by asking: who is on my team? This question arises whether it is the first day at the stock exchange or the kindergarten. Therefore, training policies for such situations in the face of imperfect information and ambiguous identities is an important problem that needs to be addressed. In this work, we develop a novel identity detection reinforcement learning (IDRL) framework that allows an agent to dynamically infer the identities of nearby agents and select an appropriate policy to accomplish the task. In the IDRL framework, a relation network is constructed to deduce the identities of other agents by observing the behaviors of the agents. A danger network is optimized to estimate the risk of false-positive identifications. Beyond that, we propose an intrinsic reward that balances the need to maximize external rewards and accurate identification. After identifying the cooperation-competition pattern among the agents, IDRL applies one of the off-the-shelf MARL methods to learn the policy. To evaluate the proposed method, we conduct experiments on Red-10 card-shedding game, and the results show that IDRL achieves superior performance over other state-of-the-art MARL methods. Impressively, the relation network has the par performance to identify the identities of agents with top human players; the danger network reasonably avoids the risk of imperfect identification. The code to reproduce all the reported results is available online at https://github.com/MR-BENjie/IDRL.

Identity-Driven Hierarchical Role-Playing Agents

Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data

RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models

From Persona to Personalization: A Survey on Role-Playing Language Agents

The Oscars of AI Theater: A Survey on Role-Playing with Language Models

On the Decision-Making Abilities in Role-Playing using Large Language Models

BEYOND DIALOGUE: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Model

Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment

RoleCraft-GLM: Advancing Personalized Role-Playing in Large Language Models

Orca: Enhancing Role-Playing Abilities of Large Language Models by Integrating Personality Traits

Role play with large language models

MMRole: A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents

Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?

ERABAL: Enhancing Role-Playing Agents through Boundary-Aware Learning

Thinking Before Speaking: A Role-playing Model with Mindset

A Multi-Task Role-Playing Agent Capable of Imitating Character Linguistic Styles

Human Simulacra: Benchmarking the Personification of Large Language Models

SocialBench: Sociality Evaluation of Role-Playing Conversational Agents

Character is Destiny: Can Large Language Models Simulate Persona-Driven Decisions in Role-Playing?

Classifying ambiguous identities in hidden-role Stochastic games with multi-agent reinforcement learning

SHARP: Unlocking Interactive Hallucination via Stance Transfer in Role-Playing Agents