Abstract:Existing data-driven and feedback traffic control strategies do not consider the heterogeneity of real-time data measurements. Besides, traditional reinforcement learning (RL) methods for traffic control usually converge slowly for lacking data efficiency. Moreover, conventional optimal perimeter control schemes require exact knowledge of the system dynamics and thus would be fragile to endogenous uncertainties. To handle these challenges, this work proposes an integral reinforcement learning (IRL) based approach to learning the macroscopic traffic dynamics for adaptive optimal perimeter control. This work makes the following primary contributions to the transportation literature: (a) A continuous-time control is developed with discrete gain updates to adapt to the discrete-time sensor data. (b) To reduce the sampling complexity and use the available data more efficiently, the experience replay (ER) technique is introduced to the IRL algorithm. (c) The proposed method relaxes the requirement on model calibration in a "model-free" manner that enables robustness against modeling uncertainty and enhances the real-time performance via a data-driven RL algorithm. (d) The convergence of the IRL-based algorithms and the stability of the controlled traffic dynamics are proven via the Lyapunov theory. The optimal control law is parameterized and then approximated by neural networks (NN), which moderates the computational complexity. Both state and input constraints are considered while no model linearization is required. Numerical examples and simulation experiments are presented to verify the effectiveness and efficiency of the proposed method.

Model-Based Real-Time Volume Control For Interactive Network Traffic Replay

Real-time Volume Control for Interactive Network Traffic Replay

System and Method for Real-Time Volume Control in Reproducing Network Scenario

Stochastic Model Predictive Control for Urban Traffic Networks

Training for More Robust and Practical Adaptive Signal Control Models

&Lt;title>automatic Traffic Real-Time Analysis System Based on Video</title>

Adaptive Rolling Smoothing with Heterogeneous Data for Traffic State Estimation and Prediction.

A Decentralized Model Predictive Traffic Signal Control Method with Fixed Phase Sequence for Urban Networks.

A Traffic Splitting Method of High-Speed Network Using Sub-Network Flow Optimization

Conversational Model Based VoIP Traffic Generation

A time window based analytical approach for splitting high-speed network traffic

A New Method for Interactive TCP Traffic Replay Based on Balance-Checking Between Transmitted and Received Packets

Data efficient reinforcement learning and adaptive optimal perimeter control of network traffic dynamics

Learning and managing stochastic network traffic dynamics: an iterative and interactive approach

A Calibrated Force-Based Model for Mixed Traffic Simulation.

Objective-aware Traffic Simulation via Inverse Reinforcement Learning

Feasibility of State Space Models for Network Traffic Generation

A New Algorithm for Network Traffic Prediction

Traffic Load Scaling for Network Design

Intelligent Video Ingestion for Real-time Traffic Monitoring

Interpretable Nonroutine Network Traffic Prediction with a Case Study