Abstract:Multi-agent systems are trained to maximize shared cost objectives, which typically reflect system-level efficiency. However, in the resource-constrained environments of mobility and transportation systems, efficiency may be achieved at the expense of fairness -- certain agents may incur significantly greater costs or lower rewards compared to others. Tasks could be distributed inequitably, leading to some agents receiving an unfair advantage while others incur disproportionately high costs. It is important to consider the tradeoffs between efficiency and fairness. We consider the problem of fair multi-agent navigation for a group of decentralized agents using multi-agent reinforcement learning (MARL). We consider the reciprocal of the coefficient of variation of the distances traveled by different agents as a measure of fairness and investigate whether agents can learn to be fair without significantly sacrificing efficiency (i.e., increasing the total distance traveled). We find that by training agents using min-max fair distance goal assignments along with a reward term that incentivizes fairness as they move towards their goals, the agents (1) learn a fair assignment of goals and (2) achieve almost perfect goal coverage in navigation scenarios using only local observations. For goal coverage scenarios, we find that, on average, our model yields a 14% improvement in efficiency and a 5% improvement in fairness over a baseline trained using random assignments. Furthermore, an average of 21% improvement in fairness can be achieved compared to a model trained on optimally efficient assignments; this increase in fairness comes at the expense of only a 7% decrease in efficiency. Finally, we extend our method to environments in which agents must complete coverage tasks in prescribed formations and show that it is possible to do so without tailoring the models to specific formation shapes.

A Fairness-Oriented Reinforcement Learning Approach for the Operation and Control of Shared Micromobility Services

Spatial-temporal Pricing for Ride-Sourcing Platform with Reinforcement Learning

Fairness-Enhancing Vehicle Rebalancing in the Ride-hailing System

Long-term Fairness in Ride-Hailing Platform

Fairness-Aware Dynamic Ride-Hailing Matching Based on Reinforcement Learning

Cooperation and Fairness in Multi-Agent Reinforcement Learning

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

Using Simple Incentives to Improve Two-Sided Fairness in Ridesharing Systems

Regulating For-Hire Autonomous Vehicles for An Equitable Multimodal Transportation Network

Scalable Multi-Objective Reinforcement Learning with Fairness Guarantees using Lorenz Dominance

Data-Driven Methods for Balancing Fairness and Efficiency in Ride-Pooling

Evaluating Fairness in Black-box Algorithmic Markets: A Case Study of Ride Sharing in Chicago

A Distributed Model-Free Ride-Sharing Approach for Joint Matching, Pricing, and Dispatching using Deep Reinforcement Learning

LEAD: Towards Learning-Based Equity-Aware Decarbonization in Ridesharing Platforms

On Accessibility Fairness in Intermodal Autonomous Mobility-on-Demand Systems

Fairness and Bias in Robot Learning

A Reinforcement Learning Approach for Dynamic Rebalancing in Bike-Sharing System

Shared micromobility and equity: A comparison between station-based, hybrid, and dockless models

Mutual Information as Intrinsic Reward of Reinforcement Learning Agents for On-demand Ride Pooling

Dual Policy Reinforcement Learning for Real-time Rebalancing in Bike-sharing Systems