Abstract:Obstacle avoidance is an important function in self-driving vehicle control. When the vehicle move from any arbitrary start positions to any target positions in environment, a proper path must avoid both static obstacles and moving obstacles of arbitrary shape. There are many possible scenarios, manually tackling all possible cases will likely yield a too simplistic policy. In this paper reinforcement learning is applied to the problem to form effective strategies. There are two major challenges that make self-driving vehicle different from other robotic tasks. Firstly, in order to control the vehicle precisely, the action space must be continuous which can't be dealt with by traditional Q-learning. Secondly, self-driving vehicle must satisfy various constraints including vehicle dynamics constraints and traffic rules constraints. Three contributions are made in this paper. Firstly, an improved Deep Deterministic Policy Gradients (DDPG) algorithm is proposed to solve the problem of continuous action space, so that the continuous steering angle and acceleration can be obtained. Secondly, according to the vehicle constraints include inside and outside, a more reasonable path for obstacle avoidance is designed. Thirdly, the various sensors data are merged into vehicle so as to satisfy the need of the input information of the algorithm, including the vehicle state and surrounding environment state. In addition to that, the algorithm are tested on an open source vehicle simulator for racing called TORCS which stands for The Open Racing Car Simulator. The result demonstrate the effectiveness and robustness of the method.

A Deep Reinforcement Learning Based Approach for Autonomous Overtaking

Learning an Efficient and Safe Policy for Highway Driving Using Supervised Learning and Reinforcement Learning.

Reinforcement Learning Based Overtaking Decision-Making for Highway Autonomous Driving

A Fuzzy-Inference-based Reinforcement Learning Method of Overtaking Decision Making for Automated Vehicles

Reinforcement Learning for Cooperative Overtaking.

Decision-making for Overtaking in Specific Unmanned Driving Scenarios based on Deep Reinforcement Learning

Heuristic Reinforcement Learning Based Overtaking Decision for an Autonomous Vehicle

Decision-making Strategy on Highway for Autonomous Vehicles using Deep Reinforcement Learning

Predictive Freeway Overtaking Strategy for Automated Vehicles Us-ing Deep Reinforcement Learning

Autonomous Overtaking Decision Making Of Driverless Bus Based On Deep Q-Learning Method

Autonomous Overtaking for Intelligent Vehicles Considering Social Preference Based on Hierarchical Reinforcement Learning

Graph Convolution Reinforcement Learning for Decision-Making in Highway Overtaking Scenario

Decision-Making for Oncoming Traffic Overtaking Scenario Using Double DQN

Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

Obstacle Avoidance for Self-Driving Vehicle with Reinforcement Learning

Roadside Units Assisted Localized Automated Vehicle Maneuvering: An Offline Reinforcement Learning Approach

Heuristics-oriented overtaking decision making for autonomous vehicles using reinforcement learning

Hierarchical Reinforcement Learning Combined with Motion Primitives for Automated Overtaking.

A Deep Reinforcement Learning-Based Approach for Autonomous Driving in Highway On-Ramp Merge

Research into Autonomous Vehicles Following and Obstacle Avoidance Based on Deep Reinforcement Learning Method under Map Constraints

Autonomous Driving in the Uncertain Traffic——a Deep Reinforcement Learning Approach