Abstract:Ineffective and inflexible traffic signal control at urban intersections can often lead to bottlenecks in traffic flows and cause congestion, delay, and environmental problems. How to manage traffic smartly by intelligent signal control is a big challenge in urban traffic management. With recent advances in machine learning, especially reinforcement learning (RL), traffic signal control using advanced machine learning techniques represents a promising solution to tackle this problem. In this paper, we propose a RL approach for traffic signal control at urban intersections. Specifically, we use neural networks as Q-function approximator (a.k.a. Q-network) to deal with the complex traffic signal control problem where the state space can be huge and the action space can be discrete. The state space is defined based on real-time traffic information, i.e. vehicle position, direction and speed. The action space includes various traffic signal phases which are critical in generating a reasonable and realistic control mechanism, given the prominent spatial-temporal characteristics of urban traffic. We use SUMO, an open source traffic simulator, to construct realistic urban intersections. Moreover, we use different traffic patterns, such as major/minor road traffic, through/left-turn lane traffic, tidal traffic, and varying demand traffic, to train a generalized traffic signal control model that can be adapted to various traffic conditions. The simulation results demonstrate the convergence and generalization performance of our RL approach as well as its significant benefits in terms of queue length and wait time over several benchmarking methods in traffic signal control.

SELF-ORGANIZED CONTROL OF TRAFFIC SIGNALS BASED ON REINFORCEMENT LEARNING AND GENETIC ALGORITHM

Q-learning Based Traffic Signal Control Method for an Isolated Intersection

Learning Traffic Signal Control via Genetic Programming

Traffic Signal Timing via Parallel Reinforcement Learning

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Environmental Adaptive Urban Traffic Signal Control Based on Reinforcement Learning Algorithm

Traffic Signal Control Reliability Optimization Based on Genetic Algorithm

Intelligent Traffic Signal Control Based on Reinforcement Learning with State Reduction for Smart Cities

Isolated intersection control based on improved genetic algorithm

Multiobjective Reinforcement Learning for Traffic Signal Control Using Vehicular Ad Hoc Network

A Traffic Signal Control Method Based on Asynchronous Reinforcement Learning

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

A multi‐agent deep reinforcement learning approach for traffic signal coordination

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Random Ensemble Reinforcement Learning for Traffic Signal Control

Cooperative Reinforcement Learning on Traffic Signal Control

Batch-Augmented Multi-Agent Reinforcement Learning for Efficient Traffic Signal Optimization

Intelligent Control Scheme for Traffic Signals at Multi-intersections based on Pedestrian Safety

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning