Abstract:The Dynamic Traffic Assignment (DTA) is one of the important measures to alleviate urban network traffic congestion. The congestions are usually caused by stochastic traffic demands, which are generally unassignable from time dimension in the real-world but are assumed to be assignable in existing DTA methods (i.e. real-time travel demands). In this paper, a distributed DTA method for preventing urban network traffic congestion caused by stochastic real-time travel demands by improving Multi-Agent Reinforcement Learning (MARL). A team structure, which consists of decision-makers and advisers, is designed to learn parallelly in realistic DTA tasks. To reduce the size of the solution space adaptively, the dynamic critical values advised by adviser agents are adopted as constraints for the strategy space of decision-makers (i.e. main agents). A collaborative heterogeneous-adviser mechanism is designed to avoid deviation of guidance. To enhance the adaptability of DTA to the changeable external environment, the mixed strategy concept is introduced to improve the decision-making process of main agents. The respective mapping mechanisms are designed to define adaptive learning rates to improve the sensitivity of MARL. The Sioux Falls (SF) network is established as a test platform via a Dynamic Network Loading (DNL). The effectiveness of the suggested DTA method is assessed through numerical simulations SF network. Under the influence of the scenario with stochastic real-time travel demands, the results show that the proposed method outperforms in terms of the throughput of the network and the individual average travel time among the overall network. Additionally, the ability of the proposed method in response to the external environment rapidly has also been demonstrated. Adopting the suggested method can improve the state of the art to assign stochastic real-time travel demands dynamically and to avoid potential traffic congestion fundamentally.

Freeway Network Simulation and Dynamic Traffic Assignment with Metanet Tools

Traffic Simulation with METANET

Feedback Routing Control Strategies For Freeway Networks: A Comparative Study

Feedback Route Guidance Applied to A Large-Scale Express Ring Road

Real-Time Route Guidance for Large-Scale Express Ring-Roads

Cellular Signaling Data Driven Simulation-Based Dynamic Traffic Assignment and Its Applications to a Real-World Road Network

REAL-TIME ROUTE GUIDANCE IN LARGE-SCALE URBAN EXPRESS RING-ROADS

Freeway Traffic State Estimation Using Fixed and Mobile Sensing Data with Microscopic Simulation Evaluation

A Predictive Feedback Routing Control Strategy for Freeway Network Traffic.

A Bayesian Stochastic Kriging Optimization Model Dealing with Heteroscedastic Simulation Noise for Freeway Traffic Management

Performance evaluation of predictive feedback routing for freeway networks

A Freeway Traffic Flow Control Model Based on Distributed Reinforcement Learning

Macroscopic Traffic Flow Modelling of Large-Scale Freeway Networks with Field Data Verification: State-of-the-art Review, Benchmarking Framework, and Case Studies Using METANET

A Hybrid Traffic Flow Model for Real Time Freeway Traffic Simulation

Traffic Events Oriented Dynamic Traffic Assignment Model for Expressway Network: A Network Flow Approach

Ramp Metering of Freeway Network Based on Dynamic Graph Hybrid Automata

A Scale-Dynamic Network Abstraction Approach for Traffic Analysis

Developing a 24-Hour Large-Scale Microscopic Traffic Simulation Model for the Before-and-After Study of a New Tolled Freeway in the Washington, DC–Baltimore Region

A Distributed Assignment Method for Dynamic Traffic Assignment Using Heterogeneous-Adviser Based Multi-Agent Reinforcement Learning

Intelligent Algorithms for Reducing Short-Term Traffic State Prediction Error in Active Traffic Management

Dynamic Traffic Assignment Integration with Real-Time Ramp Metering for Large-Scale Network Management.