Abstract:Ineffective and inflexible traffic signal control at urban intersections can often lead to bottlenecks in traffic flows and cause congestion, delay, and environmental problems. How to manage traffic smartly by intelligent signal control is a big challenge in urban traffic management. With recent advances in machine learning, especially reinforcement learning (RL), traffic signal control using advanced machine learning techniques represents a promising solution to tackle this problem. In this paper, we propose a RL approach for traffic signal control at urban intersections. Specifically, we use neural networks as Q-function approximator (a.k.a. Q-network) to deal with the complex traffic signal control problem where the state space can be huge and the action space can be discrete. The state space is defined based on real-time traffic information, i.e. vehicle position, direction and speed. The action space includes various traffic signal phases which are critical in generating a reasonable and realistic control mechanism, given the prominent spatial-temporal characteristics of urban traffic. We use SUMO, an open source traffic simulator, to construct realistic urban intersections. Moreover, we use different traffic patterns, such as major/minor road traffic, through/left-turn lane traffic, tidal traffic, and varying demand traffic, to train a generalized traffic signal control model that can be adapted to various traffic conditions. The simulation results demonstrate the convergence and generalization performance of our RL approach as well as its significant benefits in terms of queue length and wait time over several benchmarking methods in traffic signal control.

A Stochastic Adaptive Traffic Signal Control Model Based on Fuzzy Reinforcement Learning

Q-learning Based Traffic Signal Control Method for an Isolated Intersection

Hierarchical Fuzzy Logic Control Using Evolution Strategy for Urban Traffic Intersection

A Traffic Signal Control Method Based on Asynchronous Reinforcement Learning

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Intelligent Traffic Signal Control Based on Reinforcement Learning with State Reduction for Smart Cities

A Decentralized Model Predictive Traffic Signal Control Method with Fixed Phase Sequence for Urban Networks.

Efficiency and Reliability Analysis of Self-Adaptive Two-Stage Fuzzy Control System in Complex Traffic Environment

Intelligent Traffic Control Decision-Making Based on Type-2 Fuzzy and Reinforcement Learning

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

Learning in practice: reinforcement learning-based traffic signal control augmented with actuated control

Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study

Environmental Adaptive Urban Traffic Signal Control Based on Reinforcement Learning Algorithm

An Intelligent Control Method for Urban Traffic Signal Based on Fuzzy Neural Network

Iterative Learning Based Adaptive Traffic Signal Control

A Reinforcement Learning Approach for Intelligent Traffic Signal Control at Urban Intersections

Urban Traffic Signals Timing at Four-Phase Signalized Intersection Based on Optimized Two-Stage Fuzzy Control Scheme

Research on Intelligent Signal Timing Optimization of Signalized Intersection Based on Deep Reinforcement Learning Using Floating Car Data

Urban Intersection Traffic Signal Control Based on Fuzzy Logic

Learning Based Fuzzy Control Strategy Design for a Signalized Intersection