Abstract:Visual object navigation is an essential task of embodied AI, which is letting the agent navigate to the goal object under the user's demand. Previous methods often focus on single-object navigation. However, in real life, human demands are generally continuous and multiple, requiring the agent to implement multiple tasks in sequence. These demands can be addressed by repeatedly performing previous single task methods. However, by dividing multiple tasks into several independent tasks to perform, without the global optimization between different tasks, the agents' trajectories may overlap, reducing the efficiency of navigation. In this paper, we propose an efficient reinforcement learning framework with a hybrid policy for multi-object navigation, aiming to maximally eliminate noneffective actions. First, the visual observations are embedded to detect the semantic entities (such as objects). And the detected objects are memorized and projected into semantic maps, which can also be regarded as a long-term memory of the observed environment. Then a hybrid policy consisting of exploration and long-term planning strategies is proposed to predict the potential target position. In particular, when the target is directly oriented, the policy function makes long-term planning for the target based on the semantic map, which is implemented by a sequence of motion actions. In the alternative, when the target is not oriented, the policy function estimates an object's potential position toward exploring the most possible objects (positions) that have close relations to the target. The relation between different objects is obtained with prior knowledge, which is used to predict the potential target position by integrating with the memorized semantic map. And then a path to the potential target is planned by the policy function. We evaluate our proposed method on two large-scale 3D realistic environment datasets, Gibson and- Matterport3D, and the experimental results demonstrate the effectiveness and generalization of the proposed method.

Multi-Object Navigation with dynamically learned neural implicit representations

Think Holistically, Act Down-to-Earth: A Semantic Navigation Strategy with Continuous Environmental Representation and Multi-step Forward Planning

Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigation

Learning with a Mole: Transferable latent spatial representations for navigation without reconstruction

Multi-Object Navigation in real environments using hybrid policies

Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networks

Cognitive Navigation by Neuro-Inspired Localization, Mapping, and Episodic Memory

Learning Dynamic Cognitive Map with Autonomous Navigation

A Navigation Cognitive System Driven by Hierarchical Spiking Neural Network.

Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models, Benchmark and Efficient Evaluation

A Novel Neural Multi-Store Memory Network for Autonomous Visual Navigation in Unknown Environment

Learning to Navigate in Complex Environments

Learning Cross Dimension Scene Representation for Interactive Navigation Agents in Obstacle-Cluttered Environments

Multi-Object Navigation Using Potential Target Position Policy Function

Memory Proxy Maps for Visual Navigation

One-4-All: Neural Potential Fields for Embodied Navigation

Cognitive Mapping and Planning for Visual Navigation

MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigation

Building Intelligent Autonomous Navigation Agents

Learning whom to trust in navigation: dynamically switching between classical and neural planning

Interpretable Brain-Inspired Representations Improve RL Performance on Visual Navigation Tasks