Abstract:The perimeter traffic control of urban road network is of great significance for alleviating traffic congestion. Most of the existing perimeter control methods are design schemes based on macroscopic fundamental diagram (MFD), accompanied by effective algorithmic techniques. However, when applying MFD-based models for perimeter traffic control, it is always restricted by the heterogeneity of road network. In response to this problem, it is urgent to find a new model, which can not only get rid of the influence of heterogeneity, but also describe the evolution of traffic flow to guide the perimeter control. Research displays that the road network traffic carrying capacity model, a model designed to calculate the maximum number of vehicles in the road network under a certain service level, can meet these requirements. First, through the theoretical demonstration of the mathematical model, it is proved that the network heterogeneity neither affects the existence of traffic carrying capacity nor changes its parameter value. This further clarifies that there is no need to divide the homogeneous sub-regions in the preliminary steps of the proposed perimeter control. Second, an innovative road network perimeter coordination control framework is developed, which has a simple operation process and high computational efficiency. The main components of the structural framework include data collector, sub-region coordination controller, and perimeter signal controller. In particular, the core idea of coordinated control is to adjust and model the distribution mode of vehicles in the road network through the transfer of traffic flow between sub-regions, thereby achieving the optimal operation efficiency of the transportation system. Finally, the SUMO simulation software is employed to verify and evaluate the proposed model. The results show that compared with the no perimeter control and the MFD-based perimeter control, the proposed perimeter control strategy is demonstrated to have impressive performance. A key advantage is that the application of the proposed approach does not need to consider the road network heterogeneity, and has great results in both non-congested and congested conditions. Findings from this study can provide a novel direction for the application of urban regional traffic control.

Beyond centralization: Non-cooperative perimeter control with extended mean-field reinforcement learning in urban road networks

Mean Field Multi-Agent Reinforcement Learning Method for Area Traffic Signal Control

A Machine Learning Method for Dynamic Traffic Control and Guidance on Freeway Networks

Freeway network traffic management based on distributed reinforcement learning

Perimeter Control with Heterogeneous Metering Rates for Cordon Signals: A Physics-Regularized Multi-Agent Reinforcement Learning Approach

Data efficient reinforcement learning and adaptive optimal perimeter control of network traffic dynamics

A Distributed Control Method For Urban Networks Using Multi-Agent Reinforcement Learning Based On Regional Mixed Strategy Nash-Equilibrium

Demonstration-guided Deep Reinforcement Learning for Coordinated Ramp Metering and Perimeter Control in Large Scale Networks

Perimeter Control Method of Road Traffic Regions Based on MFD-DDPG

Learning Decentralized Traffic Signal Controllers with Multi-Agent Graph Reinforcement Learning

Coordinated Perimeter Control of Urban Road Network Based on Traffic Carrying Capacity Model

Adaptive Traffic Signal Control for Large-Scale Scenario with Cooperative Group-based Multi-agent Reinforcement Learning

The Study of Reinforcement Learning for Traffic Self-Adaptive Control under Multiagent Markov Game Environment

Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions using Reinforcement Learning

A Reinforcement Learning Based Traffic Control Strategy in a Macroscopic Fundamental Diagram Region

Learning scalable multi-agent coordination by spatial differentiation for traffic signal control

Coordinated Control of Urban Expressway Integrating Adjacent Signalized Intersections Using Adversarial Network Based Reinforcement Learning Method

Perimeter Control Using Deep Reinforcement Learning: A Model-free Approach towards Homogeneous Flow Rate Optimization

Integrating independent and centralized multi-agent reinforcement learning for traffic signal network optimization