Abstract:Abstract End-to-end autonomous driving approach seeks to solve the problems of perception, decision and control in an integrated way, which can better adapt to the new traffic scene. Due to the diversity of traffic scenes and the uncertainty of the interaction among surrounding vehicles, the design of autonomous driving policy is challenging. Many current methods manually design the corresponding driving policy for different traffic scene, resulting in suboptimal solutions and the maintaining is hard. Most of the existing deep reinforcement learning (DRL) methods can’t work well in the complex urban traffic scenes because of the sensing and simple driving policy. In this paper, to extend the adaptability of the SAC-based method, we proposed to take the multiple sensor data as input, and a VAE network was used to enhance the quality of training data for SAC-based DRL method. A multi-constraints reward function for SAC-based driving policy training is designed, which account for the errors of transverse distance, longitudinal distance, heading, velocity and the possibility of collision. The multiple sensor data include the original RGB image captured by forward-view camera, a 3D LiDAR and the bird’s-eye view map resulted from the perception processing, the mixed inputs could enrich the capability of scene perception. The proposed approach is validated with the multi-vehicle traffic simulation built with CARLA[1]. The results showed that the simulated vehicle could adapt to more challenging traffic scenes, like passing intersections and turning in crowded urban scenes, etc with the driving policy generated by the proposed method, and its performances are obviously outperformed against the existing similar methods.

Continual Reinforcement Learning for Autonomous Driving with Application on Velocity Control under Various Environment

Learning an Efficient and Safe Policy for Highway Driving Using Supervised Learning and Reinforcement Learning.

Deterministic Promotion Reinforcement Learning Applied to Longitudinal Velocity Control for Automated Vehicles

Human-Like Longitudinal Velocity Control Based on Continuous Reinforcement Learning

Reinforcement Learning-Based High-Speed Path Following Control for Autonomous Vehicles

RISE: A Velocity Control Framework with Minimal Impacts Based on Reinforcement Learning

Speed Tracking Control Via Online Continuous Actor-Critic Learning

Velocity Control in Car-Following Behavior with Autonomous Vehicles Using Reinforcement Learning

A Multi-sensing Input and Multi-constraint Reward Mechanism Based Deep Reinforcement Learning Method for Self-driving Policy Learning

Multi-policy Soft Actor-Critic Reinforcement Learning for Autonomous Racing

A Combined Reinforcement Learning and Model Predictive Control for Car-Following Maneuver of Autonomous Vehicles

Multi-objective Optimization Based Deep Reinforcement Learning for Autonomous Driving Policy

Life-Long Multi-Task Learning of Adaptive Path Tracking Policy for Autonomous Vehicle

Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

Combining Deep Reinforcement Learning and Safety Based Control for Autonomous Driving

Obstacle Avoidance for Self-Driving Vehicle with Reinforcement Learning

Design and Experimental Validation of a Cooperative Adaptive Cruise Control System Based on Supervised Reinforcement Learning

Continual Learning for Adaptable Car-Following in Dynamic Traffic Environments

Reinforcement Learning-Based Approach to Reduce Velocity Error in Car-Following for Autonomous Connected Vehicles

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

Continuous Control in Car Simulator with Deep Reinforcement Learning