Visual Navigation Subject to Embodied Mismatch

Xinzhu Liu,Di Guo,Huaping Liu,Xinyu Zhang,Fuchun Sun

DOI: https://doi.org/10.1109/TCDS.2023.3238840

IF: 4.546

2023-01-01

IEEE Transactions on Cognitive and Developmental Systems

Abstract:In the embodied visual navigation task, the agent navigates to a target location based on the visual observation it collects during the interaction with the environment. And, various approaches have been proposed to learn robust navigation strategies for this task. However, existing approaches assume that the action spaces in the training and testing phases are the same, which is usually not the case in reality. And, thus, it is difficult to directly apply these approaches on practical scenarios. In this article, we consider the situation where the action spaces in the training and testing phases are different, and a novel task of visual navigation subject to embodied mismatch is proposed. To solve the proposed task, we establish a two-stage robust adversary learning framework which can learn a robust policy to adapt the learned model to a new action space. In the first stage, an adversary training mechanism is used to learn a robust feature representation of the state. In the second stage, an adaptation training is used to transfer the learned strategy to a new action space with fewer training samples. Experiments of three types of embodied visual navigation tasks are conducted in 3-D indoor scenes demonstrating the effectiveness of the proposed approach.