Abstract:Autonomously exploring and mapping unknown indoor scenes is a prerequisite for many robotic tasks. Deep reinforcement learning-based methods can teach a robot to leverage structural regularities of indoor scenes via interaction with the environment. Therefore, an efficient and robust exploration strategy is assured. The existing approaches either directly control the robot's motions, which leads to long decision sequences and necessitates an enormous number of training samples, or indirectly specify a long-term goal but do not guarantee the goal's reachability, which hinders the training as well. To overcome these problems, we propose a novel autonomous scene exploration method, using an experience enhancement algorithm to accelerate policy training and generate highly efficient exploratory targets. We first incorporate an off-policy reinforcement learning algorithm and the experience replay buffer mechanism. Then, a global exploration policy is used to specify a long-term goal. Next, we take advantage of an incremental heuristic pathfinding algorithm to plan a collision-avoidance path to the long-term goal. When the robot follows the path, we divide it into several segments and evaluate the subpath rewards, which help further improve existing experiences. Finally, the experiences are filtered based on the temporal difference error and stored in the experience replay buffer. The proposed method can extract correct behaviors from past failures and designate accessible long-term goals. Through various experiments, we validated that our approach can effectively improve the training efficiency of the global exploration policy and the final performance of the overall system.

Absorb What You Need: Accelerating Exploration Via Valuable Knowledge Extraction

PAE: Reinforcement Learning from External Knowledge for Efficient Exploration

KICE: A Knowledge Consolidation and Expansion Framework for Relation Extraction.

EXTRACT: Efficient Policy Learning by Extracting Transferable Robot Skills from Offline Data

Knowledge-guided Open Attribute Value Extraction with Reinforcement Learning

Knowledge Extraction in Low-Resource Scenarios: Survey and Perspective

Knowledge is reward: Learning optimal exploration by predictive reward cashing

Attention-based Exploitation and Exploration Strategy for Multi-Hop Knowledge Graph Reasoning

REX: Rapid Exploration and eXploitation for AI Agents

Incorporating Explanations to Balance the Exploration and Exploitation of Deep Reinforcement Learning.

KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning

DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population

KoGuN: Accelerating Deep Reinforcement Learning Via Integrating Human Suboptimal Knowledge.

Accelerating deep reinforcement learning via knowledge-guided policy network

RLeXplore: Accelerating Research in Intrinsically-Motivated Reinforcement Learning

KDDLSA:A Knowledge Extraction Framework Integrating Deep Learning and Syntactic Analysis

Adaptive Ordered Information Extraction with Deep Reinforcement Learning

Exploration in Knowledge Transfer Utilizing Reinforcement Learning

Autonomous Scene Exploration Using Experience Enhancement

Optimized Feature Extraction for Sample Efficient Deep Reinforcement Learning

ACDER: Augmented Curiosity-Driven Experience Replay