Abstract:Collision avoidance is one of the most fundamental and challenging aspects of socially aware robot navigation. Recently, numerous works based on reinforcement learning (RL) have been proposed for collision avoidance in experimental settings. However, reinforcement learning approaches face two challenges: managing lengthy training processes and generalizing in volatile environments. These issues arise because reinforcement learning must initiate training whenever it encounters new environments or environmental changes. In this work, we present an algorithm that executes without prior training and adaptively optimizes itself when the environment changes. Its training is its execution. The novelty of this work is twofold: 1. developing a fluctuating epsilon model, which is entirely new and designed from scratch. It adjusts the exploration probability based on the performance of the algorithm. 2. developing a velocity obstacle-based exploration model, which innovatively combines Reinforcement Learning (RL) with the Velocity Obstacles (VO) method by replacing random exploration in RL with the classic collision avoidance algorithm, the Optimal Reciprocal Collision Avoidance (ORCA) algorithm, to create our innovative exploration model. Our proposed algorithm is evaluated in simulation scenarios. Experimental results demonstrate that our comprehensive model outperforms the state-of-the-art (SOTA) baseline algorithms, achieving a 3.23% increase in success rate. Moreover, our model continues to excel even when the environment changes, consistently improving its performance. Specifically, after environmental changes, our model's success rate exceeds that of the baseline by 17.49%.

Imminent Collision Mitigation with Reinforcement Learning and Vision

Secondary crash mitigation controller after rear-end collisions using reinforcement learning

Deep Reinforcement Learning for Human-Like Driving Policies in Collision Avoidance Tasks of Self-Driving Cars

Crash Mitigation Controller for Unavoidable T-bone Collisions Using Reinforcement Learning.

Reinforcement Learning based Control of Imitative Policies for Near-Accident Driving

Modeling Interactions of Autonomous Vehicles and Pedestrians with Deep Multi-Agent Reinforcement Learning for Collision Avoidance

Deep Reinforcement Learning for Advanced Longitudinal Control and Collision Avoidance in High-Risk Driving Scenarios

Emergency Collision Avoidance Decision-making for Autonomous Vehicles: A Model-based Reinforcement Learning Approach

Collision Anticipation via Deep Reinforcement Learning for Visual Navigation

Learn Collision-Free Self-Driving Skills at Urban Intersections with Model-Based Reinforcement Learning

Least-Restrictive Multi-Agent Collision Avoidance via Deep Meta Reinforcement Learning and Optimal Control

Autonomous Highway Merging in Mixed Traffic Using Reinforcement Learning and Motion Predictive Safety Controller

Multi-Vehicle Mixed-Reality Reinforcement Learning for Autonomous Multi-Lane Driving

RACE-SM: Reinforcement Learning Based Autonomous Control for Social On-Ramp Merging

Modeling driver's evasive behavior during safety-critical lane changes:Two-dimensional time-to-collision and deep reinforcement learning

Deep-Reinforcement-Learning-Based Collision Avoidance of Autonomous Driving System for Vulnerable Road User Safety

Implicit Sensing in Traffic Optimization: Advanced Deep Reinforcement Learning Techniques

Hybrid Deep Reinforcement Learning and Planning for Safe and Comfortable Automated Driving

Spatial-based Predictive Control for Vehicle Collision Avoidance by Steering Maneuvers

Adaptive Environment Modeling Based Reinforcement Learning for Collision Avoidance in Complex Scenes

Training Is Execution: A Reinforcement Learning-Based Collision Avoidance Algorithm for Volatile Scenarios