Abstract:The Dynamic Traffic Assignment (DTA) is one of the important measures to alleviate urban network traffic congestion. The congestions are usually caused by stochastic traffic demands, which are generally unassignable from time dimension in the real-world but are assumed to be assignable in existing DTA methods (i.e. real-time travel demands). In this paper, a distributed DTA method for preventing urban network traffic congestion caused by stochastic real-time travel demands by improving Multi-Agent Reinforcement Learning (MARL). A team structure, which consists of decision-makers and advisers, is designed to learn parallelly in realistic DTA tasks. To reduce the size of the solution space adaptively, the dynamic critical values advised by adviser agents are adopted as constraints for the strategy space of decision-makers (i.e. main agents). A collaborative heterogeneous-adviser mechanism is designed to avoid deviation of guidance. To enhance the adaptability of DTA to the changeable external environment, the mixed strategy concept is introduced to improve the decision-making process of main agents. The respective mapping mechanisms are designed to define adaptive learning rates to improve the sensitivity of MARL. The Sioux Falls (SF) network is established as a test platform via a Dynamic Network Loading (DNL). The effectiveness of the suggested DTA method is assessed through numerical simulations SF network. Under the influence of the scenario with stochastic real-time travel demands, the results show that the proposed method outperforms in terms of the throughput of the network and the individual average travel time among the overall network. Additionally, the ability of the proposed method in response to the external environment rapidly has also been demonstrated. Adopting the suggested method can improve the state of the art to assign stochastic real-time travel demands dynamically and to avoid potential traffic congestion fundamentally.

A Novel Parallel Computing Framework for Traffic Assignment Problem: Integrating Alternating Direction Method of Multipliers with Jacobi over Relaxation Method

A Novel Framework of the Alternating Direction Method of Multipliers with Application to Traffic Assignment Problem

Freeway Network Simulation and Dynamic Traffic Assignment with Metanet Tools

Integrating Alternating Direction Method of Multipliers and Bush for Solving the Traffic Assignment Problem

An Alternating Direction Method of Multipliers for Solving User Equilibrium Problem

A parallel computing framework for solving user equilibrium problem on computer clusters

Parallel computing for continuous traffic flow model

A Parallel Computing Approach to Solve Traffic Assignment Using Path-Based Gradient Projection Algorithm

Parallel Implementations Of Dynamic Traffic Assignment Models

Quasi-Dynamic Traffic Assignment using High Performance Computing

Application Of Distributed And Parallel Computing In Traffic Network Simulation

THE PARALLEL PROCESSING METHOD IN NEURAL NETWORKS FOR TRAFFIC EQUILIBRIUM ASSIGNMENT PROBLEMS

Efficient Computation of User Optimal Traffic Assignment Via Second-Order Cone and Linear Programming Techniques

The design and implement of parallel simulation algorithm of dynamic route solution for traffic network

A Distributed Computing Method Integrating Improved Gradient Projection for Solving Stochastic Traffic Equilibrium Problem

A Distributed Assignment Method for Dynamic Traffic Assignment Using Heterogeneous-Adviser Based Multi-Agent Reinforcement Learning

A Method for Parallelizing Traffic Network Simulation Based on Space Domain Decomposition

A Customized Two-Stage Parallel Computing Algorithm for Solving the Combined Modal Split and Traffic Assignment Problem

Improved ADMM-based Approach for Optimizing Intercity Express Transportation Networks: A Novel Dual Decomposition Strategy with Partial Retention of Coupling Constraints

Distributed Urban Freeway Traffic Optimization Considering Congestion Propagation

Optimized Coordination of Arterial Road Traffic Signals with Alternating Direction Multiplier Method