Underwater Multi-Sensor Fusion Localization with Visual-Inertial-depth Using Hybrid Residuals and Efficient Loop Closing

Shuoshuo Ding,Tiedong Zhang,Ye Li,Shuo Xu,Ming Lei
DOI: https://doi.org/10.1016/j.measurement.2024.115245
IF: 5.6
2024-01-01
Measurement
Abstract:Unmanned underwater vehicles (UUVs) need robust localization systems to complete their missions safely. To address the degradation of the localization accuracy of UUVs using visual-based simultaneous localization and mapping (SLAM) in underwater environments. A full SLAM system that fuses visual-inertial-depth measurements using hybrid residuals and efficient loop closing is proposed. Specifically, a novel visual hybrid residual is presented with an adaptive dynamic weighting factor. Reprojection and photometric double constraints are constructed simultaneously using the selected robust features. These constraints are then optimized jointly with the IMU measurements and the relative depth measurements to obtain a more accurate pose. Furthermore, a new three-step image-to-sequence strategy and a convolutional auto-encoder (CAE)-based global image representation are adopted to select candidate frames in order to improve the recall of underwater visual loop closure detection. Quantitative and qualitative analyses of real-world artificial pool and ocean experiments demonstrate the accuracy and effectiveness of the proposed system.
What problem does this paper attempt to address?