Abstract:Operation of Autonomous Mobile Robots (AMRs) of all forms that include wheeled ground vehicles, quadrupeds and humanoids in dynamically changing GPS denied environments without a-priori maps, exclusively using onboard sensors, is an unsolved problem that has potential to transform the economy, and vastly improve humanity's capabilities with improvements to agriculture, manufacturing, disaster response, military and space exploration. Conventional AMR automation approaches are modularized into perception, motion planning and control which is computationally inefficient, and requires explicit feature extraction and engineering, that inhibits generalization, and deployment at scale. Few works have focused on real-world end-to-end approaches that directly map sensor inputs to control outputs due to the large amount of well curated training data required for supervised Deep Learning (DL) which is time consuming and labor intensive to collect and label, and sample inefficiency and challenges to bridging the simulation to reality gap using Deep Reinforcement Learning (DRL). This paper presents a novel method to efficiently train DRL for robust end-to-end AMR exploration, in a constrained environment at physical limits in simulation, transferred zero-shot to the real-world. The representation learned in a compact parameter space with 2 fully connected layers with 64 nodes each is demonstrated to exhibit emergent behavior for out-of-distribution generalization to navigation in new environments that include unstructured terrain without maps, and dynamic obstacle avoidance. The learned policy outperforms conventional navigation algorithms while consuming a fraction of the computation resources, enabling execution on a range of AMR forms with varying embedded computer payloads.

Deep Reinforcement Learning Robot for Search and Rescue Applications: Exploration in Unknown Cluttered Environments

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

An improved frontier-based robot exploration strategy combined with deep reinforcement learning

Selective Exploration and Information Gathering in Search and Rescue Using Hierarchical Learning Guided by Natural Language Input

From Simulations to Reality: Enhancing Multi-Robot Exploration for Urban Search and Rescue

Automatic Object Searching and Behavior Learning for Mobile Robots in Unstructured Environment by Deep Belief Networks.

Exploration Without Maps via Zero-Shot Out-of-Distribution Deep Reinforcement Learning

Towards Cognitive Exploration through Deep Reinforcement Learning for Mobile Robots

Deep Reinforcement Learning for Time-Critical Wilderness Search And Rescue Using Drones

A Sim-to-Real Pipeline for Deep Reinforcement Learning for Autonomous Robot Navigation in Cluttered Rough Terrain

Causal Reinforcement Learning for Optimisation of Robot Dynamics in Unknown Environments

Deep Reinforcement Learning-based Large-scale Robot Exploration

Learning to Explore Indoor Environments using Autonomous Micro Aerial Vehicles

Vision-based navigation and obstacle avoidance via deep reinforcement learning

Deep Reinforcement Learning for Autonomous Ground Vehicle Exploration Without A-Priori Maps

Target Search and Navigation in Heterogeneous Robot Systems with Deep Reinforcement Learning

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Off-road Autonomous Vehicles Traversability Analysis and Trajectory Planning Based on Deep Inverse Reinforcement Learning

Deep Reinforcement Learning for Robot Collision Avoidance With Self-State-Attention and Sensor Fusion

Multi-Agent Exploration of an Unknown Sparse Landmark Complex via Deep Reinforcement Learning

Deep Reinforcement Learning with Dynamic Graphs for Adaptive Informative Path Planning