Abstract:Controlling traffic signals to alleviate increasing traffic pressure is a concept that has received public attention for a long time. However, existing systems and methodologies for controlling traffic signals are insufficient for addressing the problem. To this end, we build a truly adaptive traffic signal control model in a traffic microsimulator, i.e., “Simulation of Urban Mobility” (SUMO), using the technology of modern deep reinforcement learning. The model is proposed based on a deep Q-network algorithm that precisely represents the elements associated with the problem: agents, environments, and actions. The real-time state of traffic, including the number of vehicles and the average speed, at one or more intersections is used as an input to the model. To reduce the average waiting time, the agents provide an optimal traffic signal phase and duration that should be implemented in both single-intersection cases and multi-intersection cases. The co-operation between agents enables the model to achieve an improvement in overall performance in a large road network. By testing with data sets pertaining to three different traffic conditions, we prove that the proposed model is better than other methods (e.g., Q-learning method, longest queue first method, and Webster fixed timing control method) for all cases. The proposed model reduces both the average waiting time and travel time, and it becomes more advantageous as the traffic environment becomes more complex.

Hardware-in-the-Loop Simulation System for Multi-Intersection Traffic Signal Control

Q-learning Based Traffic Signal Control Method for an Isolated Intersection

Traffic Signal Control Optimization Strategy Based on Simulation

General Multi-Phase Intelligent Control Method for Traffic Flow at Single Intersection

Design and Implementation of Simulation System for Signalized Intersection with Tram Priority

Design of On-line Simulation System for Signal Control of Urban Intersections Based on Visual Sensing Technology

Research on integrated simulation platform for urban traffic control connecting simulation and practice

Design and Realization of Intersection Traffic Control Simulation System Using Connected Vehicle Technology

Design of an Intelligent Traffic Controller Based on Vehicle Detection Technology

Visual Simulation of Signal Timing in City Intersection

A simulation system and speed guidance algorithms for intersection traffic control using connected vehicle technology

Application Of Fuzzy Control Theory In Multi Phase Traffic Control Of Single Intersection

Fuzzy Neural Network Control Technique and Its Application in A Complex Intersection

Study on Traffic Control Simulation System Based on VISSIM

Simulation Study of Mixed Traffic in China--a Practice in Beijing

Evaluation and Simulation Study of Traffic at Intersection of Wuhan Heping Avenue-Jianshe No.2 Road

Application of fuzzy control theory in multi-phase traffic control of single intersection

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

Improving Performance of Coordinated Signal Control Systems Using Signal and Loop Data

Study on Interactive Hardware In-Loop Simulation System for Intelligent Transport

Modelling And Traffic Signal Control Of A Heterogeneous Traffic Network With Signalized And Non-Signalized Intersections