Research on tightly coupled visual inertial SLAM based on point and line features

Jiajia Lu,Yue Shen,Qilin Hang,Yue Tang
DOI: https://doi.org/10.1007/s00530-024-01482-x
IF: 3.9
2024-09-25
Multimedia Systems
Abstract:Aiming at the problem of poor quality of point and line feature extraction and poor localization accuracy of visual inertial system in dimly lit and sparsely textured scenes, a tightly coupled visual inertial simultaneous localization and mapping approach based on point and line features is proposed. The front-end grid division of the image, combined with the image information entropy value and image grayscale information to dynamically adjust the feature point extraction threshold, to improve the stability of feature extraction; the introduction of line segment detector line features, based on the length of the filtering threshold to eliminate short line segments, merge the neighboring lines, to improve the quality of feature extraction, and finally, based on the pre-integration of the processing of the inertial measurement unit data, and initialization of visual inertia alignment. The back-end designs a sliding window tightly coupled optimization model, limits the amount of system data, preserves the constraint relationship between the rejected data frames, establishes a visual bag-of-words model containing point and line features to achieve loopback detection and relocation in order to improve the system's localization accuracy, and verifies the method's performance through simulation and real-world scenarios. The results show that the accuracy and robustness of this paper's algorithm are better than the mainstream algorithm in both bright and dim scenes, and the localization error ratio is 0.025% in bright scenes and 0.036% in dim scenes.
computer science, information systems, theory & methods
What problem does this paper attempt to address?