Abstract:Multi-agent systems are trained to maximize shared cost objectives, which typically reflect system-level efficiency. However, in the resource-constrained environments of mobility and transportation systems, efficiency may be achieved at the expense of fairness -- certain agents may incur significantly greater costs or lower rewards compared to others. Tasks could be distributed inequitably, leading to some agents receiving an unfair advantage while others incur disproportionately high costs. It is important to consider the tradeoffs between efficiency and fairness. We consider the problem of fair multi-agent navigation for a group of decentralized agents using multi-agent reinforcement learning (MARL). We consider the reciprocal of the coefficient of variation of the distances traveled by different agents as a measure of fairness and investigate whether agents can learn to be fair without significantly sacrificing efficiency (i.e., increasing the total distance traveled). We find that by training agents using min-max fair distance goal assignments along with a reward term that incentivizes fairness as they move towards their goals, the agents (1) learn a fair assignment of goals and (2) achieve almost perfect goal coverage in navigation scenarios using only local observations. For goal coverage scenarios, we find that, on average, our model yields a 14% improvement in efficiency and a 5% improvement in fairness over a baseline trained using random assignments. Furthermore, an average of 21% improvement in fairness can be achieved compared to a model trained on optimally efficient assignments; this increase in fairness comes at the expense of only a 7% decrease in efficiency. Finally, we extend our method to environments in which agents must complete coverage tasks in prescribed formations and show that it is possible to do so without tailoring the models to specific formation shapes.

Fairness-utility Trade-off in Multi-Agent Scheduling

On the Price of Anarchy of Two-Stage Machine Scheduling Games

Price of Fairness for Allocating a Bounded Resource

Coordination mechanisms for selfish parallel jobs scheduling

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Fair scheduling on parallel batch machines with non-identical capacities

Fair Algorithm Design: Fair and Efficacious Machine Scheduling

Job fairness in non-preemptive job scheduling

An Auction-Based Approach for Multi-Agent Uniform Parallel Machine Scheduling with Dynamic Jobs Arrival

Fair Robust Assignment using Redundancy

Fairness in Repetitive Scheduling

Conflict and Fairness in Resource Allocation

Multi-resource fairness: Objectives, algorithms and performance

The Price of Fairness in Bipartite Matching

Fair Distribution of Delivery Orders

A New Fairness Model based on User's Objective for Multi-user Multi-processor Online Scheduling

Fairness in Academic Course Timetabling

Fair and Welfare-Efficient Constrained Multi-matchings under Uncertainty

Clustering-based Multi-objective Optimization Considering Fairness for Multi-workflow Scheduling on Clouds

Fair Allocation Without Trade

Cooperation and Fairness in Multi-Agent Reinforcement Learning