Abstract:Ineffective and inflexible traffic signal control at urban intersections can often lead to bottlenecks in traffic flows and cause congestion, delay, and environmental problems. How to manage traffic smartly by intelligent signal control is a big challenge in urban traffic management. With recent advances in machine learning, especially reinforcement learning (RL), traffic signal control using advanced machine learning techniques represents a promising solution to tackle this problem. In this paper, we propose a RL approach for traffic signal control at urban intersections. Specifically, we use neural networks as Q-function approximator (a.k.a. Q-network) to deal with the complex traffic signal control problem where the state space can be huge and the action space can be discrete. The state space is defined based on real-time traffic information, i.e. vehicle position, direction and speed. The action space includes various traffic signal phases which are critical in generating a reasonable and realistic control mechanism, given the prominent spatial-temporal characteristics of urban traffic. We use SUMO, an open source traffic simulator, to construct realistic urban intersections. Moreover, we use different traffic patterns, such as major/minor road traffic, through/left-turn lane traffic, tidal traffic, and varying demand traffic, to train a generalized traffic signal control model that can be adapted to various traffic conditions. The simulation results demonstrate the convergence and generalization performance of our RL approach as well as its significant benefits in terms of queue length and wait time over several benchmarking methods in traffic signal control.

Reinforcement Learning-based Security Enhancement for Controlled Optimization of Phases in Intelligent Traffic Signal System

Enhancing Road Safety and Cybersecurity in Traffic Management Systems: Leveraging the Potential of Reinforcement Learning

Reinforcement Learning based Cyberattack Model for Adaptive Traffic Signal Controller in Connected Transportation Systems

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Deep Reinforcement Learning-Based Intelligent Security Forwarding Strategy for VANET

Collaborative Attack Sequence Generation Model Based on Multiagent Reinforcement Learning for Intelligent Traffic Signal System

Urban Traffic Signal Control Robust Optimization Against Risk-averse and Worst-case Cyberattacks.

A Deep Reinforcement Learning Approach for Isolated Intersection Traffic Signal Control with Long-Short Term Memory Network

Learning in practice: reinforcement learning-based traffic signal control augmented with actuated control

Adaptive urban traffic signal control based on enhanced deep reinforcement learning

DNLight: Learning Efficient Evaluation for Traffic Signal Control

Adversarial Attacks and Defense in Deep Reinforcement Learning (DRL)-Based Traffic Signal Controllers

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

Learning Phase Competition for Traffic Signal Control

SafeLight: A Reinforcement Learning Method toward Collision-free Traffic Signal Control

Attacking Deep Reinforcement Learning-Based Traffic Signal Control Systems with Colluding Vehicles

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Mitigating Action Hysteresis in Traffic Signal Control with Traffic Predictive Reinforcement Learning

Expression might be enough: representing pressure and demand for reinforcement learning based traffic signal control