Abstract:Multi-agent systems are trained to maximize shared cost objectives, which typically reflect system-level efficiency. However, in the resource-constrained environments of mobility and transportation systems, efficiency may be achieved at the expense of fairness -- certain agents may incur significantly greater costs or lower rewards compared to others. Tasks could be distributed inequitably, leading to some agents receiving an unfair advantage while others incur disproportionately high costs. It is important to consider the tradeoffs between efficiency and fairness. We consider the problem of fair multi-agent navigation for a group of decentralized agents using multi-agent reinforcement learning (MARL). We consider the reciprocal of the coefficient of variation of the distances traveled by different agents as a measure of fairness and investigate whether agents can learn to be fair without significantly sacrificing efficiency (i.e., increasing the total distance traveled). We find that by training agents using min-max fair distance goal assignments along with a reward term that incentivizes fairness as they move towards their goals, the agents (1) learn a fair assignment of goals and (2) achieve almost perfect goal coverage in navigation scenarios using only local observations. For goal coverage scenarios, we find that, on average, our model yields a 14% improvement in efficiency and a 5% improvement in fairness over a baseline trained using random assignments. Furthermore, an average of 21% improvement in fairness can be achieved compared to a model trained on optimally efficient assignments; this increase in fairness comes at the expense of only a 7% decrease in efficiency. Finally, we extend our method to environments in which agents must complete coverage tasks in prescribed formations and show that it is possible to do so without tailoring the models to specific formation shapes.

Strategy and Fairness in Repeated Two-agent Interaction

Incorporating Fairness into Infinitely Repeated Games with Conflicting Interests for Conflicts Elimination

Incorporating Fairness into Agent Interactions Modeled as Two-Player Normal-Form Games

Adaptive algorithm for multi-agent learning optimal cooperative pursuit strategy based on Markov game

Achieving Fairness in Multi-Agent Markov Decision Processes Using Reinforcement Learning

Fairness in Cooperative Multiagent Systems

Fairness in Multi-agent Reinforcement Learning for Stock Trading

Introducing Decision Entrustment Mechanism into Repeated Bilateral Agent Interactions to Achieve Social Optimality

Long-Term Fairness in Sequential Multi-Agent Selection with Positive Reinforcement

How is the AI Perceived when It Behaves (Un)fairly?

Achieving Socially Optimal Outcomes in Multiagent Systems with Reinforcement Social Learning

Reciprocal Social Strategy in Social Repeated Games.

Interactions in Multiagent Systems: Fairness, Social Optimality and Individual Rationality

Learning Fairness in Multi-Agent Systems

Adaptive role switching promotes fairness in networked ultimatum game

Convex Markov Games: A Framework for Fairness, Imitation, and Creativity in Multi-Agent Learning

Reciprocal Social Strategy in Social Repeated Games and Emergence of Social Norms.

Robustness Analysis of Negotiation Strategies through Multiagent Learning in Repeated Negotiation Games.

Cooperative Multi-Agent Fairness and Equivariant Policies

Cooperation and Fairness in Multi-Agent Reinforcement Learning

Maintaining Cooperation in Homogeneous Multi-Agent System