Abstract:Autonomous exploration and mapping of unknown terrains employing single or multiple robots is an essential task in mobile robotics and has therefore been widely investigated. Nevertheless, given the lack of unified data sets, metrics, and platforms to evaluate the exploration approaches, we develop an autonomous robot exploration benchmark en-titled Explore-Bench. The benchmark involves various explo-ration scenarios and presents two types of quantitative metrics to evaluate exploration efficiency and multi-robot cooperation. Explore-Bench is extremely useful as, recently, deep rein-forcement learning (DRL) has been widely used for robot exploration tasks and achieved promising results. However, training DRL-based approaches requires large data sets, and additionally, current benchmarks rely on realistic simulators with a slow simulation speed, which is not appropriate for training exploration strategies. Hence, to support efficient DRL training and comprehensive evaluation, the suggested Explore-Bench designs a 3-level platform with a unified data flow and 12 × speed-up that includes a grid-based simulator for fast evaluation and efficient training, a realistic Gazebo simulator, and a remotely accessible robot testbed for high-accuracy tests in physical environments. The practicality of the proposed benchmark is highlighted with the application of one DRL-based and three frontier-based exploration approaches. Fur-thermore, we analyze the performance differences and provide some insights about the selection and design of exploration methods. Our benchmark is available at https://github.com/efc-robot/Explore-Bench.

Benchmarking Safe Exploration in Deep Reinforcement Learning

Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmark

Learning to be Safe: Deep RL with a Safety Critic

ActSafe: Active Exploration with Safety Constraints for Reinforcement Learning

Safeguarded Progress in Reinforcement Learning: Safe Bayesian Exploration for Control Policy Synthesis

Human-Robot Gym: Benchmarking Reinforcement Learning in Human-Robot Collaboration

Look Before You Leap: Safe Model-Based Reinforcement Learning with Human Intervention

Revisiting Safe Exploration in Safe Reinforcement learning

Safe Reinforcement Learning in a Simulated Robotic Arm

Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigation

Explore-Bench: Data Sets, Metrics and Evaluations for Frontier-based and Deep-reinforcement-learning-based Autonomous Exploration

Cautious Adaptation For Reinforcement Learning in Safety-Critical Settings

Safe Exploration in Reinforcement Learning: A Generalized Formulation and Algorithms

GUARD: A Safe Reinforcement Learning Benchmark

Iterative Reachability Estimation for Safe Reinforcement Learning

Aquatic Navigation: A Challenging Benchmark for Deep Reinforcement Learning

Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificate

State-Wise Safe Reinforcement Learning With Pixel Observations

Reinforcement Learning by Guided Safe Exploration

safe-control-gym: a Unified Benchmark Suite for Safe Learning-based Control and Reinforcement Learning in Robotics

A Review of Safe Reinforcement Learning: Methods, Theory and Applications