Abstract:The Dynamic Traffic Assignment (DTA) is one of the important measures to alleviate urban network traffic congestion. The congestions are usually caused by stochastic traffic demands, which are generally unassignable from time dimension in the real-world but are assumed to be assignable in existing DTA methods (i.e. real-time travel demands). In this paper, a distributed DTA method for preventing urban network traffic congestion caused by stochastic real-time travel demands by improving Multi-Agent Reinforcement Learning (MARL). A team structure, which consists of decision-makers and advisers, is designed to learn parallelly in realistic DTA tasks. To reduce the size of the solution space adaptively, the dynamic critical values advised by adviser agents are adopted as constraints for the strategy space of decision-makers (i.e. main agents). A collaborative heterogeneous-adviser mechanism is designed to avoid deviation of guidance. To enhance the adaptability of DTA to the changeable external environment, the mixed strategy concept is introduced to improve the decision-making process of main agents. The respective mapping mechanisms are designed to define adaptive learning rates to improve the sensitivity of MARL. The Sioux Falls (SF) network is established as a test platform via a Dynamic Network Loading (DNL). The effectiveness of the suggested DTA method is assessed through numerical simulations SF network. Under the influence of the scenario with stochastic real-time travel demands, the results show that the proposed method outperforms in terms of the throughput of the network and the individual average travel time among the overall network. Additionally, the ability of the proposed method in response to the external environment rapidly has also been demonstrated. Adopting the suggested method can improve the state of the art to assign stochastic real-time travel demands dynamically and to avoid potential traffic congestion fundamentally.

Integration of an Agent-Based Joint Route and Departure Time Choice Model with the Dynamic Traffic Assignment Package

Integrating Mesoscopic Dynamic Traffic Assignment with Agent-Based Travel Behavior Models for Cumulative Land Development Impact Analysis

Agent-Based Microsimulation Approach for Design and Evaluation of Flexible Work Schedules

Dynamic Transportation Planning and Operations: Concept, Framework and Applications in China

Integrated Vehicle and Passenger Simulation Model Considering a Multimodal Transportation Network

Day-to-Day Dynamic Traffic Assignment with Imperfect Information, Bounded Rationality and Information Sharing

A Dynamic Day-To-Day Departure Time and Route Choice Model for Bounded-Rational Individuals

Dynamic Traffic Assignment Based on Logit Model

Dynamic micro-assignment modeling approach for integrated multimodal urban corridor management

Combined Activity/Travel Choice Models: Time-Dependent and Dynamic Versions

Day-to-day Traffic Flow Assignment Model Considering Departure Time Adjustment

A Simultaneous Route and Departure Time Choice Model for Evacuation Planning

Model and Algorithm of Dynamic Routing Based on Simulation

A joint travel mode and departure time choice model in dynamic multimodal transportation networks based on deep reinforcement learning

Multiclass, Simultaneous Route and Departure Time Choice Dynamic Traffic Assignment with an Embedded Spatial Queuing Model

Multi-agent Negotiation Approach to Simulate and Analyze Route Choice Behavior

Activity-based Traveler Agent Behavioral Model for Mixed Traffic Flow

Model framework of driver's real-time dynamic route choice behaviors based on agent

A Distributed Assignment Method for Dynamic Traffic Assignment Using Heterogeneous-Adviser Based Multi-Agent Reinforcement Learning

An Agent-Based Choice Model for Travel Mode and Departure Time and Its Case Study in Beijing

Agent-based Approach to Model Commuter Behaviour's Day-to-day Dynamics under Pre-Trip Information