Abstract:Today mobile users learn and share their traffic observations via crowdsourcing platforms (e.g., Waze). Yet such platforms simply cater to selfish users' myopic interests to recommend the shortest path, and do not encourage enough users to travel and learn other paths for future others. Prior studies focus on one-shot congestion games without considering users' information learning, while our work studies how users learn and alter traffic conditions on stochastic paths in a human-in-the-loop manner. Our analysis shows that the myopic routing policy leads to severe under-exploration of stochastic paths. This results in a price of anarchy (PoA) greater than $2$, as compared to the socially optimal policy in minimizing the long-term social cost. Besides, the myopic policy fails to ensure the correct learning convergence about users' traffic hazard beliefs. To address this, we focus on informational (non-monetary) mechanisms as they are easier to implement than pricing. We first show that existing information-hiding mechanisms and deterministic path-recommendation mechanisms in Bayesian persuasion literature do not work with even (\text{PoA}=\infty). Accordingly, we propose a new combined hiding and probabilistic recommendation (CHAR) mechanism to hide all information from a selected user group and provide state-dependent probabilistic recommendations to the other user group. Our CHAR successfully ensures PoA less than (\frac{5}{4}), which cannot be further reduced by any other informational (non-monetary) mechanism. Besides the parallel network, we further extend our analysis and CHAR to more general linear path graphs with multiple intermediate nodes, and we prove that the PoA results remain unchanged. Additionally, we carry out experiments with real-world datasets to further extend our routing graphs and verify the close-to-optimal performance of our CHAR.

Counter-Intuitive Effects of Q-Learning Exploration in a Congestion Dilemma

How individuals learn to take turns: Emergence of alternating cooperation in a congestion game and the prisoner's dilemma

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

Congested Urban Networks Tend to Be Insensitive to Signal Settings: Implications for Learning-Based Control

Human-in-the-loop Learning for Dynamic Congestion Games

Distributed Learning for Dynamic Congestion Games

The Perils of Exploration under Competition: A Computational Modeling Approach

Stability of Multi-Agent Learning in Competitive Networks: Delaying the Onset of Chaos

Traffic Assignment Paradox Incorporating Congestion and Stochastic Perceived Error Simultaneously

On the Importance of Exploration for Real Life Learned Algorithms

Improved cooperation by balancing exploration and exploitation in intertemporal social dilemma tasks

To Optimize Human-in-the-loop Learning in Repeated Routing Games

Solving N-player dynamic routing games with congestion: a mean field approach

Dynamic Subgoal-based Exploration via Bayesian Optimization

Learning and choosing in an uncertain world: An investigation of the explore-exploit dilemma in static and dynamic environments

Learning How to Dynamically Route Autonomous Vehicles on Shared Roads

Deterministic Exploration via Stationary Bellman Error Maximization

Braess's Paradox Analog in Physical Networks of Optimal Exploration

Effect of Q-learning on the Evolution of Cooperation Behavior in Collective Motion: an Improved Vicsek Model

Learning to Influence Vehicles' Routing in Mixed-Autonomy Networks by Dynamically Controlling the Headway of Autonomous Cars

Learning in a complex world: Insights from an OLG lab experiment