Abstract:In this paper, we study the problem of traffic signal control in general intersections by applying a recent reinforcement learning technique. Nowadays, traffic congestion and road usage are increasing significantly as more and more vehicles enter the same infrastructures. New solutions are needed to minimize travel times or maximize the network capacity (throughput). Recent studies embrace machine learning approaches that have the power to aid and optimize the increasing demands. However, most reinforcement learning algorithms fail to be adaptive regarding goal functions. To this end, we provide a novel successor feature-based solution to control a single intersection to optimize the traffic flow, reduce the environmental impact, and promote sustainability. Our method allows for flexibility and adaptability to changing circumstances and goals. It supports changes in preferences during inference, so the behavior of the trained agent (traffic signal controller) can be changed rapidly during the inference time. By introducing the successor features to the domain, we define the basics of successor features, the base reward functions, and the goal preferences of the traffic signal control system. As our main direction, we tackle environmental impact reduction and support prioritized vehicles' commutes. We include an evaluation of how our method achieves a more effective operation considering the environmental impact and how adaptive it is compared to a general Deep-Q-Network solution. Aside from this, standard rule-based and adaptive signal-controlling technologies are compared to our method to show its advances. Furthermore, we perform an ablation analysis on the adaptivity of the agent and demonstrate a consistent level of performance under similar circumstances.

Adaptive Traffic Signal Control: Deep Reinforcement Learning Algorithm with Experience Replay and Target Network

Uniformity of Markov Elements in Deep Reinforcement Learning for Traffic Signal Control

A Deep Reinforcement Learning Approach to Traffic Signal Control With Temporal Traffic Pattern Mining

Training for More Robust and Practical Adaptive Signal Control Models

Adaptive urban traffic signal control based on enhanced deep reinforcement learning

Adaptive Traffic Signal Control with Deep Reinforcement Learning An Exploratory Investigation

Deep Reinforcement Learning for Traffic Signal Control Model and Adaptation Study

Environmental Adaptive Urban Traffic Signal Control Based on Reinforcement Learning Algorithm

Adaptive Traffic Signal Control With Deep Reinforcement Learning and High Dimensional Sensory Inputs: Case Study and Comprehensive Sensitivity Analyses

Deep Reinforcement Learning for Adaptive Traffic Signal Control

Adaptive Traffic Signal Control with Deep Recurrent Q-learning

A Deep Reinforcement Learning Approach for Isolated Intersection Traffic Signal Control with Long-Short Term Memory Network

Using a Deep Reinforcement Learning Agent for Traffic Signal Control

A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization

DNLight: Learning Efficient Evaluation for Traffic Signal Control

Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

Improved Deep Reinforcement Learning for Intelligent Traffic Signal Control Using ECA_LSTM Network

Optimizing Traffic Signal Control in Mixed Traffic Scenarios: A Predictive Traffic Information-Based Deep Reinforcement Learning Approach

Optimization Control of Adaptive Traffic Signal with Deep Reinforcement Learning

Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Traffic Signal Control with Successor Feature-Based Deep Reinforcement Learning Agent