Abstract:To improve the traffic safety and efficiency of freeway tunnels, this study proposes a novel variable speed limit (VSL) control strategy based on the model-based reinforcement learning framework (MBRL) with safety perception. The MBRL framework is designed by developing a multi-lane cell transmission model for freeway tunnels as an environment model, which is built so that agents can interact with the environment model while interacting with the real environment to improve the sampling efficiency of reinforcement learning. Based on a real-time crash risk prediction model for freeway tunnels that uses random deep and cross networks, the safety perception function inside the MBRL framework is developed. The reinforcement learning components fully account for most current tunnels' application conditions, and the VSL control agent is trained using a deep dyna-Q method. The control process uses a safety trigger mechanism to reduce the likelihood of crashes caused by frequent changes in speed. The efficacy of the proposed VSL strategies is validated through simulation experiments. The results show that the proposed VSL strategies significantly increase traffic safety performance by between 16.00% and 20.00% and traffic efficiency by between 3.00% and 6.50% compared to a fixed speed limit approach. Notably, the proposed strategies outperform traditional VSL strategy based on the traffic flow prediction model in terms of traffic safety and efficiency improvement, and they also outperform the VSL strategy based on model-free reinforcement learning framework when sampling efficiency is considered together. In addition, the proposed strategies with safety triggers are safer than those without safety triggers. These findings demonstrate the potential for MBRL-based VSL strategies to improve traffic safety and efficiency within freeway tunnels.

Variable Speed Limit Control at Freeway Merge Bottlenecks Based on Reinforcement Learning 0

Deep Reinforcement Learning Based Lane-Level Variable Speed Limit Control

Reinforcement Learning-Based Variable Speed Limit Control Strategy to Reduce Traffic Congestion at Freeway Recurrent Bottlenecks

Coordinated Variable Speed Limit Control for Consecutive Bottlenecks on Freeways Using Multiagent Reinforcement Learning

Differential Variable Speed Limits Control for Freeway Recurrent Bottlenecks via Deep Reinforcement learning

Enhancing Transferability of Deep Reinforcement Learning-Based Variable Speed Limit Control Using Transfer Learning

TD3LVSL: A Lane-Level Variable Speed Limit Approach Based on Twin Delayed Deep Deterministic Policy Gradient in a Connected Automated Vehicle Environment

Development of Control Strategy of Variable Speed Limits for Improving Traffic Operations at Freeway Bottlenecks

Variable Speed Limit Control for Mixed Traffic Flow on Highways Based on Deep-Reinforcement Learning

A New Reinforcement Learning-Based Variable Speed Limit Control Approach to Improve Traffic Efficiency Against Freeway Jam Waves

A variable speed limit control approach for freeway tunnels based on the model-based reinforcement learning framework with safety perception

Multi-Agent Deep Reinforcement Learning for Multi-Lane Freeways Differential Variable Speed Limit Control in Mixed Traffic Environment

Variable Speed Limit Strategy to Improve the Safety and Environmental Impact of Freeway Traffic

Integrated Variable Speed Limits and Lane-Changing Control for Freeway Lane-Drop Bottlenecks

Variable Speed Limit Modelling to Improve Traffic Safety and Efficiency of Mixed Traffic Flow by a Two-Stage Framework

Variable Speed Limit Control for the Motorway–Urban Merging Bottlenecks Using Multi-Agent Reinforcement Learning

Improvement of Traffic Efficiency at Freeway Bottleneck with Traffic Control Measures

Variable speed limit control at fixed freeway bottlenecks using connected vehicles

Enhancing multi-scenario applicability of freeway variable speed limit control strategies using continual learning

Evaluating Performance of a Proactive Optimal Variable Speed Limit Control Using Different Objective Functions

A Lane-Based Variable Speed Limit Control Method with the Application of Dedicated Lane Policy for Connected and Autonomous Vehicles