HERO-SLAM: Hybrid Enhanced Robust Optimization of Neural SLAM

Zhe Xin,Yufeng Yue,Liangjun Zhang,Chenming Wu
2024-07-26
Abstract:Simultaneous Localization and Mapping (SLAM) is a fundamental task in robotics, driving numerous applications such as autonomous driving and virtual reality. Recent progress on neural implicit SLAM has shown encouraging and impressive results. However, the robustness of neural SLAM, particularly in challenging or data-limited situations, remains an unresolved issue. This paper presents HERO-SLAM, a Hybrid Enhanced Robust Optimization method for neural SLAM, which combines the benefits of neural implicit field and feature-metric optimization. This hybrid method optimizes a multi-resolution implicit field and enhances robustness in challenging environments with sudden viewpoint changes or sparse data collection. Our comprehensive experimental results on benchmarking datasets validate the effectiveness of our hybrid approach, demonstrating its superior performance over existing implicit field-based methods in challenging scenarios. HERO-SLAM provides a new pathway to enhance the stability, performance, and applicability of neural SLAM in real-world scenarios. Code is available on the project page: <a class="link-external link-https" href="https://hero-slam.github.io" rel="external noopener nofollow">this https URL</a>.
Robotics
What problem does this paper attempt to address?
This paper attempts to solve the problem of insufficient robustness of Neural SLAM (Simultaneous Localization and Mapping) in complex or data - limited situations. Specifically, existing SLAM methods based on neural implicit fields have poor performance and stability when facing sudden view - angle changes or sparse data collection. To solve these problems, the author proposes a new hybrid enhanced robust optimization method - HERO - SLAM. ### Main problems 1. **Insufficient robustness**: Existing Neural SLAM methods perform poorly when dealing with challenging scenarios (such as sudden view - angle changes or sparse data collection). 2. **High consumption of computing resources**: Traditional methods rely on high - frequency data input and have high requirements for computing resources, making it difficult to be applied in practical scenarios. 3. **Local minimum problem**: Learning optimization methods based on gradient descent are prone to fall into local minima, resulting in optimization failure. ### Solutions To improve the robustness and applicability of Neural SLAM in complex environments, HERO - SLAM introduces the following improvements: - **Hybrid representation**: Combine the advantages of neural implicit fields and feature - metric optimization, and optimize the implicit fields through multi - resolution feature encoding. - **Multi - scale loss function**: Adopt a multi - scale patch loss function to optimize the hybrid feature - metric implicit field, which is calculated based on the warping between feature points, feature maps and RGB - D pixels. - **Feature - matching constraints**: Use SuperPoint to extract feature descriptors and perform feature matching through LightGlue to further improve the robustness of optimization. ### Experimental verification Through experiments on multiple benchmark datasets, HERO - SLAM has demonstrated its superior performance in various complex scenarios, especially being able to maintain high reconstruction quality and pose - estimation accuracy even under low - frequency image sequences. ### Summary HERO - SLAM significantly improves the stability and performance of Neural SLAM in complex environments by fusing neural implicit fields and feature - metric optimization methods, providing a new solution for practical applications.