Abstract:Visual object navigation is an essential task of embodied AI, which is letting the agent navigate to the goal object under the user's demand. Previous methods often focus on single-object navigation. However, in real life, human demands are generally continuous and multiple, requiring the agent to implement multiple tasks in sequence. These demands can be addressed by repeatedly performing previous single task methods. However, by dividing multiple tasks into several independent tasks to perform, without the global optimization between different tasks, the agents' trajectories may overlap, reducing the efficiency of navigation. In this paper, we propose an efficient reinforcement learning framework with a hybrid policy for multi-object navigation, aiming to maximally eliminate noneffective actions. First, the visual observations are embedded to detect the semantic entities (such as objects). And the detected objects are memorized and projected into semantic maps, which can also be regarded as a long-term memory of the observed environment. Then a hybrid policy consisting of exploration and long-term planning strategies is proposed to predict the potential target position. In particular, when the target is directly oriented, the policy function makes long-term planning for the target based on the semantic map, which is implemented by a sequence of motion actions. In the alternative, when the target is not oriented, the policy function estimates an object's potential position toward exploring the most possible objects (positions) that have close relations to the target. The relation between different objects is obtained with prior knowledge, which is used to predict the potential target position by integrating with the memorized semantic map. And then a path to the potential target is planned by the policy function. We evaluate our proposed method on two large-scale 3D realistic environment datasets, Gibson and- Matterport3D, and the experimental results demonstrate the effectiveness and generalization of the proposed method.

GAPLE: Generalizable Approaching Policy LEarning for Robotic Object Searching in Indoor Environment

Learning Hierarchical Graph-Based Policy for Goal-Reaching in Unknown Environments

Generalize Robot Learning from Demonstration to Variant Scenarios with Evolutionary Policy Gradient

Active Object Perceiver: Recognition-Guided Policy Learning for Object Searching on Mobile Robots

3D-Aware Object Goal Navigation Via Simultaneous Exploration and Identification

Automatic Object Searching and Behavior Learning for Mobile Robots in Unstructured Environment by Deep Belief Networks.

Learning Human Search Behavior from Egocentric Visual Inputs

LeLaN: Learning A Language-Conditioned Navigation Policy from In-the-Wild Videos

Spatial-Language Attention Policies for Efficient Robot Learning

Learning Object Relation Graph and Goal-Aware Policy for Visual Room Rearrangement

Learning and Planning with a Semantic Model

Pave the Way to Grasp Anything: Transferring Foundation Models for Universal Pick-Place Robots

SEEK: Semantic Reasoning for Object Goal Navigation in Real World Inspection Tasks

Goal-Reaching Policy Learning from Non-Expert Observations via Effective Subgoal Guidance

Towards Generalization and Data Efficient Learning of Deep Robotic Grasping

Multi-Object Navigation Using Potential Target Position Policy Function

Learning a Group-Aware Policy for Robot Navigation

SEER: Safe Efficient Exploration for Aerial Robots using Learning to Predict Information Gain

Towards Target-Driven Visual Navigation in Indoor Scenes via Generative Imitation Learning

P3-PO: Prescriptive Point Priors for Visuo-Spatial Generalization of Robot Policies

Unsupervised Visual Odometry and Action Integration for PointGoal Navigation in Indoor Environment