Abstract:Ineffective and inflexible traffic signal control at urban intersections can often lead to bottlenecks in traffic flows and cause congestion, delay, and environmental problems. How to manage traffic smartly by intelligent signal control is a big challenge in urban traffic management. With recent advances in machine learning, especially reinforcement learning (RL), traffic signal control using advanced machine learning techniques represents a promising solution to tackle this problem. In this paper, we propose a RL approach for traffic signal control at urban intersections. Specifically, we use neural networks as Q-function approximator (a.k.a. Q-network) to deal with the complex traffic signal control problem where the state space can be huge and the action space can be discrete. The state space is defined based on real-time traffic information, i.e. vehicle position, direction and speed. The action space includes various traffic signal phases which are critical in generating a reasonable and realistic control mechanism, given the prominent spatial-temporal characteristics of urban traffic. We use SUMO, an open source traffic simulator, to construct realistic urban intersections. Moreover, we use different traffic patterns, such as major/minor road traffic, through/left-turn lane traffic, tidal traffic, and varying demand traffic, to train a generalized traffic signal control model that can be adapted to various traffic conditions. The simulation results demonstrate the convergence and generalization performance of our RL approach as well as its significant benefits in terms of queue length and wait time over several benchmarking methods in traffic signal control.

PrivacySignal: Privacy-Preserving Traffic Signal Control for Intelligent Transportation System

Q-learning Based Traffic Signal Control Method for an Isolated Intersection

Privacy-Preserving Adaptive Traffic Signal Control in a Connected Vehicle Environment

An Intelligent Traffic Signal Control System Based on Deep Reinforcement Learning

Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detection

A Survey on Deep Learning-Based Traffic Signal Control

DNLight: Learning Efficient Evaluation for Traffic Signal Control

Adaptive urban traffic signal control based on enhanced deep reinforcement learning

A Gain With No Pain: Exploring Intelligent Traffic Signal Control for Emergency Vehicles

Deep Q learning-based traffic signal control algorithms: Model development and evaluation with field data

Using Reinforcement Learning With Partial Vehicle Detection for Intelligent Traffic Signal Control

Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

Using a Deep Reinforcement Learning Agent for Traffic Signal Control

Research on Intelligent Signal Timing Optimization of Signalized Intersection Based on Deep Reinforcement Learning Using Floating Car Data

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study

Traffic Signal Phase Control at Urban Isolated Intersections: An Adaptive Strategy Utilizing the Improved D3QN Algorithm

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning