Abstract:Leveraging the connectivity and automation of vehicles to enhance traffic control is becoming an advanced yet challenging topic in future city operations. Under a fully connected and automated environment, a novel traffic control scheme capable of integrating performance guarantees, generality, scalability, and conceptual simplicity, called Rhythmic Control (RC), has been proposed recently. RC establishes a set of regularly and recurrently moving virtual containers in a network; vehicles can flow within the pre-designed virtual containers to fulfill their trips and avoid collisions or stops at intersections. This paper conducts a thorough theoretical investigation on the control performances of RC in general road networks, including both one-way and two-way networks. First, under a static setting, we mathematically characterize the concept of demand accommodation of a rhythm design, and derive upper bounds for the system delay conditioned on cycle length. Then, under a stationary stochastic traffic setting, we prove that RC maximizes network throughput, and for RC in two-way road networks, we theoretically quantify its throughput enhancement compared to traffic signal control. Even so, the rhythm designed to stabilize a demand could exhibit an excessively long cycle. To relieve this issue, we further propose a variant of RC allowing strategic holdings, and prove that a rhythm design with strategic holdings can stabilize any demand it can accommodate under mild conditions. On such basis, we analyze the approximated throughput-maximizing capability of RC with strategic holdings when the allowable cycle length is limited. Extensive simulation studies are conducted to test and evaluate the control performances of the proposed RC, including a test with a realistic-size road network in Beijing, China. The results show that RC distinctively outperforms other benchmark control schemes, especially under heavy traffic scenarios.

Antifragile Perimeter Control: Anticipating and Gaining from Disruptions with Reinforcement Learning

Data efficient reinforcement learning and adaptive optimal perimeter control of network traffic dynamics

Antifragile Control Systems: The case of an oscillator-based network model of urban road traffic dynamics

Towards Robust Deep Reinforcement Learning for Traffic Signal Control: Demand Surges, Incidents and Sensor Failures

Perceptual Interaction-Based Path Tracking Control of Autonomous Vehicles under DoS Attacks: A Reinforcement Learning Approach

The Fragile Nature of Road Transportation Systems

Beyond centralization: Non-cooperative perimeter control with extended mean-field reinforcement learning in urban road networks

Adaptive Coordination Offsets for Signalized Arterial Intersections using Deep Reinforcement Learning

An Efficient Deep Reinforcement Learning Model for Urban Traffic Control

Leveraging reinforcement learning for dynamic traffic control: A survey and challenges for field implementation

Improving the generalizability and robustness of large-scale traffic signal control

Rhythmic Control of Automated Traffic in General Road Networks

Offline Reinforcement Learning for Road Traffic Control

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

Improving the Urban Transport System Resilience Through Adaptive Traffic Signal Control Enabled by Decentralised Multiagent Reinforcement Learning

Urban traffic resilience control -- An ecological resilience perspective

Learning Phase Competition for Traffic Signal Control

A scalable approach to optimize traffic signal control with federated reinforcement learning

Deep Reinforcement Learning for Adaptive Traffic Signal Control

Real-time system optimal traffic routing under uncertainties -- Can physics models boost reinforcement learning?

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections