Abstract:Abstract End-to-end autonomous driving approach seeks to solve the problems of perception, decision and control in an integrated way, which can better adapt to the new traffic scene. Due to the diversity of traffic scenes and the uncertainty of the interaction among surrounding vehicles, the design of autonomous driving policy is challenging. Many current methods manually design the corresponding driving policy for different traffic scene, resulting in suboptimal solutions and the maintaining is hard. Most of the existing deep reinforcement learning (DRL) methods can’t work well in the complex urban traffic scenes because of the sensing and simple driving policy. In this paper, to extend the adaptability of the SAC-based method, we proposed to take the multiple sensor data as input, and a VAE network was used to enhance the quality of training data for SAC-based DRL method. A multi-constraints reward function for SAC-based driving policy training is designed, which account for the errors of transverse distance, longitudinal distance, heading, velocity and the possibility of collision. The multiple sensor data include the original RGB image captured by forward-view camera, a 3D LiDAR and the bird’s-eye view map resulted from the perception processing, the mixed inputs could enrich the capability of scene perception. The proposed approach is validated with the multi-vehicle traffic simulation built with CARLA[1]. The results showed that the simulated vehicle could adapt to more challenging traffic scenes, like passing intersections and turning in crowded urban scenes, etc with the driving policy generated by the proposed method, and its performances are obviously outperformed against the existing similar methods.

Automatic learning-based data optimization method for autonomous driving

Driving Behaviour Style Study with a Hybrid Deep Learning Framework Based on GPS Data

Learning an Efficient and Safe Policy for Highway Driving Using Supervised Learning and Reinforcement Learning.

Data-driven rolling eco-speed optimization for autonomous vehicles

Collaborative processing and data optimization of environmental perception technologies for autonomous vehicles

Large-Scale Bandwidth and Power Optimization for Multi-Modal Edge Intelligence Autonomous Driving

Flexi-Compression: A Flexible Model Compression Method for Autonomous Driving

Active Data Acquisition in Autonomous Driving Simulation

A Vision-Based Method for Improving the Safety of Self-Driving

Using Meta-Learning to Establish a Highly Transferable Driving Speed Prediction Model from the Visual Road Environment

Enhancing autonomous driving systems with deep learning and spatial channel attention mechanisms: an experimental study

Bi-Level Optimization Augmented with Conditional Variational Autoencoder for Autonomous Driving in Dense Traffic

Joint Optimization of Sensing, Decision-making and Motion-controlling for Autonomous Vehicles: A Deep Reinforcement Learning Approach

An Energy-Efficient Driving Method for Connected and Automated Vehicles Based on Reinforcement Learning

Adaptive Optimization Strategy and Evaluation of Vehicle-Road Collaborative Perception Algorithm in Real-Time Settings

Application Optimization of Fine-grained Vehicle Classification based on Backbone Network

Hybrid Electric Vehicle Energy Management with Computer Vision and Deep Reinforcement Learning

Image Filtering Techniques for Object Recognition in Autonomous Vehicles

Adaptive Optimization of Autonomous Vehicle Computational Resources for Performance and Energy Improvement

Multi-objective Optimization Based Deep Reinforcement Learning for Autonomous Driving Policy

Preliminary Investigation into Data Scaling Laws for Imitation Learning-Based End-to-End Autonomous Driving