Collaborative Control Method of Transit Signal Priority Based on Cooperative Game and Reinforcement Learning

Hao Qin,Weishi Zhang

2024-05-01

Abstract:To address the low efficiency in priority signal control within intelligent transportation systems, this study introduces a novel eight-phase priority signal control method, CBQL-TSP, leveraging a hybrid decision-making framework that integrates cooperative game theory and reinforcement learning. This approach conceptualizes the allocation of bus signal priorities as a multi-objective decision-making problem across an eight-phase signal sequence, differentiating between priority and non-priority phases. It employs a cooperative game model to facilitate this differentiation. The developed hybrid decision-making algorithm, CBQL, effectively tackles the multi-objective decision-making challenges inherent in the eight-phase signal sequence. By computing the Shapley value function, it quantifies the marginal contributions of each participant, which in turn inform the construction of a state transition probability equation based on Shapley value ratios. Compared to conventional control methods, the CBQL-TSP method not only upholds the fairness principles of cooperative game theory but also harnesses the adaptive learning capabilities of Q-Learning. This enables dynamic adjustments to signal timing in response to real-time traffic conditions, significantly enhancing the flexibility and efficiency of priority signal control.

Computer Science and Game Theory

What problem does this paper attempt to address?

This paper aims to address the problem of inefficiency in priority signal control in intelligent transportation systems. A new eight-stage priority signal control method, called CBQL-TSP, is proposed in this study, which combines cooperative game theory and reinforcement learning in a hybrid decision-making framework. This method treats bus signal prioritization as a multi-objective decision-making problem, distinguishing between priority and non-priority stages, and utilizing a cooperative game model for differentiation. By calculating the Shapley value function to quantify the marginal contributions of each participant, a state transition probability equation based on Shapley value ratios is constructed. Compared to traditional control methods, CBQL-TSP not only follows the fairness principle of cooperative games but also utilizes the adaptive learning ability of Q-learning to dynamically adjust signal timing in response to real-time traffic conditions, thus significantly improving the flexibility and efficiency of priority signal control. The effectiveness of the new method in optimizing traffic flow, improving bus service reliability, and reducing traffic congestion is verified through simulation experiments in the paper.

Collaborative Control Method of Transit Signal Priority Based on Cooperative Game and Reinforcement Learning

Q-learning Based Traffic Signal Control Method for an Isolated Intersection

Proactive Coordination of Traffic Guidance and Signal Control for a Divergent Network

Transit Signal Priority under Connected Vehicle Environment: Deep Reinforcement Learning Approach

DRL-based adaptive signal control for bus priority service under connected vehicle environment

Deep Q-Learning Network Model for Optimizing Transit Bus Priority at Multiphase Traffic Signal Controlled Intersection

Multi-agent Fuzzy Signal Control with Bus Priority

An Approach of Transit Passive Priority with Transit Phase Overlapped at Intersection of Arterial Signal Progression

Simulation analysis of traffic signal control and transit signal priority strategies under Arterial Coordination Conditions

Multi-Agent Fuzzy-Based Transit Signal Priority Control for Traffic Network Considering Conflicting Priority Requests

A Decentralized Model Predictive Traffic Signal Control Method with Fixed Phase Sequence for Urban Networks.

Adaptive Transit Signal Priority based on Deep Reinforcement Learning and Connected Vehicles in a Traffic Microsimulation Environment

Adaptive urban traffic signal control based on enhanced deep reinforcement learning

Control Strategies for Transit Priority Based on Queue Modeling and Surrogate Testing

Transit Signal Priority Strategy with Heterogeneous Graph-Based Deep Reinforcement Learning for Autonomous Public Transit Vehicles

Transit Signal Priority Method Based on Speed Guidance and Coordination Among Consecutive Intersections

Intelligent Traffic Signal Control Based on Reinforcement Learning with State Reduction for Smart Cities

Integrating Transit Signal Priority into Multi-Agent Reinforcement Learning based Traffic Signal Control

A Trajectory‐Based Control Strategy with Vehicle Cooperation and Absolute Transit Priority at an Isolated Intersection

Cooperative Reinforcement Learning on Traffic Signal Control

The Coordination Between Traffic Signal Control Agents Based on Q-leaming