Abstract:Autonomous navigation substantially depends on memory mechanisms for enhancing path optimality. However, the dynamic nature of environments can cause inconsistencies between the stored scene memory and real-time perception, leading to potentially catastrophic navigation errors. Existing memory structures often fall short in addressing these challenges, as they typically only account for object-level dynamics and falter when faced with long-term alterations in environmental structure. To counter these constraints, this paper presents a learning-based framework designed to construct and maintain a geometric memory, thereby facilitating improved visuomotor navigation under structural dynamics. This proposed framework employs visual inputs to construct a geometric representation of the environment, and identifies structural changes by assessing the consistency between the established memory and instantaneous perception. To update the geometric memory efficiently, we introduce a memory updater grounded in a structure storage pool. Furthermore, a two-phase hierarchical planner is proposed to decompose navigation tasks and formulate smooth navigation strategies. Experimental results from photorealistic simulations underscore the efficacy of the proposed system in managing long-term dynamics and navigation control. The effectiveness of the proposed system is further corroborated through deployment and testing in real-world environments. Note to Practitioners—Classic geometry-based navigation methods hinge on the construction of a global map for spatial reasoning and optimized robot control. Within a learning-based pipeline, the dependence on memory information becomes critical for enabling robots to develop spatial and temporal awareness. While the maintenance of memory structures can significantly expand the field of the robot’s perception in time and space, discrepancies between historical memory and real-time perception in dynamic environments can lead to misguided decisions. Unlike most existing research that addresses short-term dynamic issues at the object level, this paper centers on long-term, large-scale dynamics precipitated by changes in environmental structure. We put forward a learning-based framework that incorporates dynamic perception, map maintenance, and hierarchical navigation. The experimental results highlight the efficiency and real-time processing capability of this method in handling structural dynamics, hence enhancing navigation efficiency.

Structurally guided task decomposition in spatial navigation tasks

Structural and Functional Neural Correlates of Spatial Navigation: a Combined Voxel-Based Morphometry and Functional Connectivity Study.

Bidirectional understanding and cooperation: interbrain neural synchronization during social navigation

Exploring and Learning Structure: Active Inference Approach in Navigational Agents

Humans decompose tasks by trading off utility and computational cost

Towards Navigation by Reasoning over Spatial Configurations

A target-driven visual navigation method based on intrinsic motivation exploration and space topological cognition

Target-Driven Structured Transformer Planner for Vision-Language Navigation

A Navigation Cognitive System Driven by Hierarchical Spiking Neural Network.

Mark it out! Spontaneous cognitive offloading in route planning

Destination-Aware Task Assignment in Spatial Crowdsourcing: A Worker Decomposition Approach

Human Navigation Network: the Intrinsic Functional Organization and Behavioral Relevance

Separable cognitive and motor decline tracked across adult life-span for goal-directed navigation

Visuomotor Navigation for Embodied Robots With Spatial Memory and Semantic Reasoning Cognition

Leveraging Hyperscanning EEG and VR Omnidirectional Treadmill to Explore Inter-Brain Synchrony in Collaborative Spatial Navigation

Online Geometric Memory Generation and Maintenance for Visuomotor Navigation in Structural Dynamic Environments

Learning Dynamic Cognitive Map with Autonomous Navigation

Forming cognitive maps for abstract spaces: the roles of the human hippocampus and orbitofrontal cortex

Cognitive Mapping and Planning for Visual Navigation

Navigation through the complex world -- the neurophysiology of decision-making processes

A comparison of reinforcement learning models of human spatial navigation