Abstract:Reinforcement learning (RL) is a promising approach in unmanned ground vehicles (UGVs) applications, but limited computing resource makes it challenging to deploy a well-behaved RL strategy with sophisticated neural networks. Meanwhile, the training of RL on navigation tasks is difficult, which requires a carefully-designed reward function and a large number of interactions, yet RL navigation can still fail due to many corner cases. This shows the limited intelligence of current RL methods, thereby prompting us to rethink combining RL with human intelligence. In this paper, a human-guided RL framework is proposed to improve RL performance both during learning in the simulator and deployment in the real world. The framework allows humans to intervene in RL's control progress and provide demonstrations as needed, thereby improving RL's capabilities. An innovative human-guided RL algorithm is proposed that utilizes a series of mechanisms to improve the effectiveness of human guidance, including human-guided learning objective, prioritized human experience replay, and human intervention-based reward shaping. Our RL method is trained in simulation and then transferred to the real world, and we develop a denoised representation for domain adaptation to mitigate the simulation-to-real gap. Our method is validated through simulations and real-world experiments to navigate UGVs in diverse and dynamic environments based only on tiny neural networks and image inputs. Our method performs better in goal-reaching and safety than existing learning- and model-based navigation approaches and is robust to changes in input features and ego kinetics. Furthermore, our method allows small-scale human demonstrations to be used to improve the trained RL agent and learn expected behaviors online.

Human-Guided Reinforcement Learning With Sim-to-Real Transfer for Autonomous Navigation

Prioritized Experience-Based Reinforcement Learning With Human Guidance for Autonomous Driving

Deep Reinforcement Learning with Heuristic Corrections for UGV Navigation

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Deep-Reinforcement-Learning-Based Autonomous UAV Navigation With Sparse Rewards

Autonomous Navigation of UAVs in Large-Scale Complex Environments: A Deep Reinforcement Learning Approach

HGRL: Human-Driving-Data Guided Reinforcement Learning for Autonomous Driving

Learning Complicated Navigation Skills from Limited Experience Via Augmenting Offline Datasets

Sim-to-Real: Mapless Navigation for USVs Using Deep Reinforcement Learning

Human-in-the-Loop Deep Reinforcement Learning with Application to Autonomous Driving

UAV navigation in high dynamic environments: A deep reinforcement learning approach

Autonomous Multi-View Navigation Via Deep Reinforcement Learning

UAV Autonomous Navigation Based on Deep Reinforcement Learning in Highly Dynamic and High-Density Environments

Group UAV Navigation by Qualifying Human-Machine Decisions in Hybrid Reinforcement Learning

Reinforcement Learning-Based Visual Navigation With Information-Theoretic Regularization

Navigation of Mobile Robots Based on Deep Reinforcement Learning: Reward Function Optimization and Knowledge Transfer

Deep reinforcement learning based mapless navigation for industrial AMRs: advancements in generalization via potential risk state augmentation

Explainable Deep Reinforcement Learning for UAV Autonomous Navigation

A UAV Navigation Approach Based on Deep Reinforcement Learning in Large Cluttered 3D Environments

Autonomous Navigation of the UAV through Deep Reinforcement Learning with Sensor Perception Enhancement

Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning