Abstract:Ineffective and inflexible traffic signal control at urban intersections can often lead to bottlenecks in traffic flows and cause congestion, delay, and environmental problems. How to manage traffic smartly by intelligent signal control is a big challenge in urban traffic management. With recent advances in machine learning, especially reinforcement learning (RL), traffic signal control using advanced machine learning techniques represents a promising solution to tackle this problem. In this paper, we propose a RL approach for traffic signal control at urban intersections. Specifically, we use neural networks as Q-function approximator (a.k.a. Q-network) to deal with the complex traffic signal control problem where the state space can be huge and the action space can be discrete. The state space is defined based on real-time traffic information, i.e. vehicle position, direction and speed. The action space includes various traffic signal phases which are critical in generating a reasonable and realistic control mechanism, given the prominent spatial-temporal characteristics of urban traffic. We use SUMO, an open source traffic simulator, to construct realistic urban intersections. Moreover, we use different traffic patterns, such as major/minor road traffic, through/left-turn lane traffic, tidal traffic, and varying demand traffic, to train a generalized traffic signal control model that can be adapted to various traffic conditions. The simulation results demonstrate the convergence and generalization performance of our RL approach as well as its significant benefits in terms of queue length and wait time over several benchmarking methods in traffic signal control.

A Method of Reinforcement Learning Based Automatic Traffic Signal Control

Q-learning Based Traffic Signal Control Method for an Isolated Intersection

Urban Road Traffic Signal Control Method Based on Agent

A Novel Method of Intelligent Traffic Signal Control

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Evaluation and Application of Urban Traffic Signal Optimizing Control Strategy Based on Reinforcement Learning

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

A Stochastic Adaptive Traffic Signal Control Model Based on Fuzzy Reinforcement Learning

A Traffic Signal Control Method Based on Asynchronous Reinforcement Learning

Traffic Signal Timing via Parallel Reinforcement Learning

Intelligent Traffic Signal Control Based on Reinforcement Learning with State Reduction for Smart Cities

Environmental Adaptive Urban Traffic Signal Control Based on Reinforcement Learning Algorithm

An Intelligent Traffic Signal Control System Based on Deep Reinforcement Learning

Agent-based Learning Control Method for Single Intersection Traffic Lights

Method of Self-Learning Traffic Signal Control

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

A multi‐agent deep reinforcement learning approach for traffic signal coordination

Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study

Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Multiobjective Reinforcement Learning for Traffic Signal Control Using Vehicular Ad Hoc Network