Boosting Explore-Exploit Behavior for Navigating Vehicle by Maintaining Informative Topological Frontier

Qiming Liu,Xinru Cui,Zhe Liu,Hesheng Wang

DOI: https://doi.org/10.1109/tiv.2024.3415734

IF: 8.2

2024-01-01

IEEE Transactions on Intelligent Vehicles

Abstract:Target search in unknown environments places high demands not only on an autonomous vehicle's ability to perceive and interpret target cues, but also on its conscious of collecting these cues by active exploration. While existing navigation methods have successfully built target-driven policies by maintaining memory of explored areas, there has been a lack of focus on facilitating target-aware exploration-the informative frontier information at unexplored yet visible areas is often overlooked. In this paper, we introduce a novel topology-based memory structure, Frontier-enhanced Topological Memory (FTM), and a Hierarchical Topology Encoding and Extraction (HTEE) module, fostering the autonomous vehicle's awareness of both environmental exploration and target approach. Specifically, FTM innovatively incorporates informative ghost nodes on traditional topological map to represent unexplored yet visible regions. We leverage an online-trained implicit scene representation to estimate the positions and generate features of these ghost nodes. The HTEE then employs implicit graph convolutions and attention mechanisms to extract cognitive information from FTM, taking into account the hierarchical memory structure, target cues, and current state. Our design bolsters cognitive navigation decisions. The experiments in the high-fidelity environments, including performance tests, visualizations, and interpretability experiments, validate the effectiveness of our approach in enhancing the vehicle's exploratory behavior. The improved exploration awareness for target cue collection, in turn, enhances the success rate and path efficiency of target search. Furthermore, we demonstrate the adaptability of our algorithm in real-world physical environments.