Abstract:Given the current limitations in intelligence and processing capabilities, machine learning systems are yet unable to fully tackle diverse scenarios, thereby restricting their potential to completely substitute for human roles in practical applications. Recognizing the robustness and adaptability demonstrated by human drivers in complex environments, autonomous driving training has incorporated driving intervention mechanisms. By integrating these interventions into Proximal Policy Optimization (PPO) algorithms, it becomes possible for drivers to intervene and rectify vehicles' irrational behaviors when necessary, during the training process, thereby significantly accelerating the enhancement of model performance. A human-centric experiential replay mechanism has been developed to increase the efficiency of utilizing driving intervention data. To evaluate the impact of driving intervention on the performance of intelligent agents, experiments were conducted across four distinct intervention frequencies within scenarios involving lane changes and navigation through congested roads. The results demonstrate that the bespoke intervention mechanism markedly improves the model's performance in the initial stages of training, enabling it to overcome local optima through timely driving interventions. Although an increase in intervention frequency typically results in improved model performance, an excessively high intervention rate can detrimentally affect the model's efficiency. To assess the practical applicability of the algorithm, a comprehensive testing scenario that includes lane changes, traffic signals, and congested road sections was devised. The performance of the trained model was evaluated under various traffic conditions. The outcomes reveal that the model can adapt to different traffic flows, successfully and safely navigate the testing segment, and maintain speeds close to the target. These findings highlight the model's robustness and its potential for real-world application, emphasizing the critical role of human intervention in enhancing the safety and reliability of autonomous driving systems.

Autonomous driving system using proximal policy optimization in deep reinforcement learning

Optimizing Autonomous Vehicle Navigation with DQN and PPO: A Reinforcement Learning Approach

Deep Reinforcement Learning with Enhanced PPO for Safe Mobile Robot Navigation

Taming an autonomous surface vehicle for path following and collision avoidance using deep reinforcement learning

Multi-Objective Autonomous Braking System using Naturalistic Dataset

Research on Autonomous Driving Decision-making Strategies based Deep Reinforcement Learning

Self-Driving Car Racing: Application of Deep Reinforcement Learning

Proximal Policy Optimization Through a Deep Reinforcement Learning Framework for Multiple Autonomous Vehicles at a Non-Signalized Intersection

Learning Robust Control Policies for End-to-End Autonomous Driving From Data-Driven Simulation

Automated Lane Change Strategy using Proximal Policy Optimization-based Deep Reinforcement Learning

Exploring the Potential of Deep Reinforcement Learning for Autonomous Navigation in Complex Environments

Efficient Learning of Safe Driving Policy via Human-AI Copilot Optimization

Automated Driving Maneuvers under Interactive Environment based on Deep Reinforcement Learning

Research on Autonomous Robots Navigation based on Reinforcement Learning

Improving the Performance of Autonomous Driving through Deep Reinforcement Learning

Deep Reinforcement Learning on Autonomous Driving Policy With Auxiliary Critic Network

Deep reinforcement learning for autonomous driving in uncontrolled intersections of Indian roads

Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization

Deep Reinforcement Learning for Human-Like Driving Policies in Collision Avoidance Tasks of Self-Driving Cars

Research on reinforcement learning based on PPO algorithm for human-machine intervention in autonomous driving