Abstract:<p>A model used for velocity control during car following is proposed based on reinforcement learning (RL). To optimize driving performance, a reward function is developed by referencing human driving data and combining driving features related to safety, efficiency, and comfort. With the developed reward function, the RL agent learns to control vehicle speed in a fashion that maximizes cumulative rewards, through trials and errors in the simulation environment. To avoid potential unsafe actions, the proposed RL model is incorporated with a collision avoidance strategy for safety checks. The safety check strategy is used during both model training and testing phases, which results in faster convergence and zero collisions. A total of 1,341 car-following events extracted from the Next Generation Simulation (NGSIM) dataset are used to train and test the proposed model. The performance of the proposed model is evaluated by the comparison with empirical NGSIM data and with adaptive cruise control (ACC) algorithm implemented through model predictive control (MPC). The experimental results show that the proposed model demonstrates the capability of safe, efficient, and comfortable velocity control and outperforms human drivers in that it 1) has larger TTC values than those of human drivers, 2) can maintain efficient and safe headways around 1.2s, and 3) can follow the lead vehicle comfortably with smooth acceleration (jerk value is only a third of that of human drivers). Compared with the MPC-based ACC algorithm, the proposed model has better performance in terms of safety, comfort, and especially running speed during testing (more than 200 times faster). The results indicate that the proposed approach could contribute to the development of better autonomous driving systems. Source code of this paper can be found at <a href="https://github.com/MeixinZhu/Velocity_control">https://github.com/MeixinZhu/Velocity_control</a>.</p>

Velocity Regulation for Automatic Train Operation Via Meta-Reinforcement Learning

Suspension Regulation of Medium-low-speed Maglev Trains via Deep Reinforcement Learning

Setpoint Tracking For The Suspension System Of Medium-Speed Maglev Trains Via Reinforcement Learning

Machine Learning Optimization of Target Velocity Curves in Hybrid Electric Trains

Train Trajectory Optimization with High-Risk State Space Boundaries: A Safe Reinforcement Learning Approach

Nonlinear model predictive control to automatic train regulation of metro system: An exact solution for embedded applications

Meta-Learning Linear Quadratic Regulators: A Policy Gradient MAML Approach for Model-free LQR

Quick Learner Automated Vehicle Adapting its Roadmanship to Varying Traffic Cultures with Meta Reinforcement Learning

Reinforcement learning method for the multi-objective speed trajectory optimization of a freight train

Optimal Automatic Train Operation Via Deep Reinforcement Learning

Virtual Parameter Learning-Based Adaptive Control for Protective Automatic Train Operation

Safe, efficient, and comfortable velocity control based on reinforcement learning for autonomous driving

Optimal Tap Setting of Voltage Regulation Transformers Using Batch Reinforcement Learning

Deterministic reinforcement learning for optimized formation control of virtually-coupled trains via performance index monitor

Dynamic Nonlinear Droop-Based Fast Frequency Regulation for Power Systems with Flexible Resources Using Meta-Reinforcement Learning Approach

Perimeter Control Using Deep Reinforcement Learning: A Model-free Approach towards Homogeneous Flow Rate Optimization

Optimizing passengers' experience: A goal-oriented reinforcement learning speed control approach for urban railway trains

Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

High-speed Train Timetabling Based on Reinforcement Learning.

Synthesis of dynamic modelling framework and optimal control strategy for virtually coupled train sets with guaranteed safety

Global composite learning velocity tracking control for heavy haul trains