Abstract:Controlling traffic signals to alleviate increasing traffic pressure is a concept that has received public attention for a long time. However, existing systems and methodologies for controlling traffic signals are insufficient for addressing the problem. To this end, we build a truly adaptive traffic signal control model in a traffic microsimulator, i.e., “Simulation of Urban Mobility” (SUMO), using the technology of modern deep reinforcement learning. The model is proposed based on a deep Q-network algorithm that precisely represents the elements associated with the problem: agents, environments, and actions. The real-time state of traffic, including the number of vehicles and the average speed, at one or more intersections is used as an input to the model. To reduce the average waiting time, the agents provide an optimal traffic signal phase and duration that should be implemented in both single-intersection cases and multi-intersection cases. The co-operation between agents enables the model to achieve an improvement in overall performance in a large road network. By testing with data sets pertaining to three different traffic conditions, we prove that the proposed model is better than other methods (e.g., Q-learning method, longest queue first method, and Webster fixed timing control method) for all cases. The proposed model reduces both the average waiting time and travel time, and it becomes more advantageous as the traffic environment becomes more complex.

Microscopic Modeling of a Signalized Traffic Intersection Using Timed Petri Nets

Modeling, Analysis, and Simulation of a Trafifc Intersection Using Timed Hybrid Petri Nets

Q-learning Based Traffic Signal Control Method for an Isolated Intersection

Petri Nets Model of Emergency Control System for Shipping

Hybrid Petri net modeling for urban traffic network

Modular design and adaptive control of urban signalized intersections systems using synchronized timed Petri nets

Distributed Traffic Signal Control of Interconnected Intersections: A Two-Lane Traffic Network Model

Visual Simulation of Signal Timing in City Intersection

Traffic Signal Priority/preemption Control with Colored Petri Nets

Lane-Based Network Data Model for Micro-Traffic Flow Simulation

A Two-level Traffic Light Control Strategy for Preventing Incident-Based Urban Traffic Congestion

Application of Petri Net with Objects in Safety System Process Modeling

General Multi-Phase Intelligent Control Method for Traffic Flow at Single Intersection

Traffic flow model by simulating circuit at signalized intersections

Modelling And Traffic Signal Control Of A Heterogeneous Traffic Network With Signalized And Non-Signalized Intersections

Modeling And Analysis Of Stage Machinery Control Systems By Timed Colored Petri Nets

A Micro-Simulation Model of Pedestrian-Vehicle Interaction Behavior at Unsignalized Mid-Block Locations

An optimization model and traffic light control scheme for heterogeneous traffic systems

Modeling, Implementation and Simulation of Virtual Factory Based on Colored Timed Petri Net.

Modelling and Traffic Signal Control of Heterogeneous Traffic Systems

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning