Abstract:In Simultaneous Localization and Mapping (SLAM), Loop Closure Detection (LCD) is essential to minimize drift when recognizing previously visited places. Visual Bag-of-Words (vBoW) has been an LCD algorithm of choice for many state-of-the-art SLAM systems. It uses a set of visual features to provide robust place recognition but fails to perceive the semantics or spatial relationship between feature points. Previous work has mainly focused on addressing these issues by combining vBoW with semantic and spatial information from objects in the scene. However, they are unable to exploit spatial information of local visual features and lack a structure that unifies semantic objects and visual features, therefore limiting the symbiosis between the two components. This paper proposes SymbioLCD2, which creates a unified graph structure to integrate semantic objects and visual features symbiotically. Our novel graph-based LCD system utilizes the unified graph structure by applying a Weisfeiler-Lehman graph kernel with temporal constraints to robustly predict loop closure candidates. Evaluation of the proposed system shows that having a unified graph structure incorporating semantic objects and visual features improves LCD prediction accuracy, illustrating that the proposed graph structure provides a strong symbiosis between these two complementary components. It also outperforms other Machine Learning algorithms - such as SVM, Decision Tree, Random Forest, Neural Network and GNN based Graph Matching Networks. Furthermore, it has shown good performance in detecting loop closure candidates earlier than state-of-the-art SLAM systems, demonstrating that extended semantic and spatial awareness from the unified graph structure significantly impacts LCD performance.

Semantics Aware Loop Closure Detection in Visual SLAM

Efficient 3D LIDAR Based Loop Closing Using Deep Neural Network

Role of Deep Learning in Loop Closure Detection for Visual and Lidar SLAM: A Survey

Loop Closure Detection for Visual SLAM Fusing Semantic Information

Loop closure detection using supervised and unsupervised deep neural networks for monocular SLAM systems

Loop closure detection based on image semantic feature and bag-of-words

Loop Closure Detection Based on Image Semantic Segmentation in Indoor Environment

Loop closure detection for visual SLAM systems using deep neural networks

A Semantic Spatial Structure-Based Loop Detection Algorithm for Visual Environmental Sensing

Loop closure detection in SLAM by combining visual and spatial appearance

SA-LOAM: Semantic-aided LiDAR SLAM with Loop Closure

Closing the Loop: Graph Networks to Unify Semantic Objects and Visual Features for Multi-object Scenes

Loop closure detection of visual SLAM based on variational autoencoder

Detection of loop closure in SLAM: A DeconvNet based approach

SeqDLF: Deep Local Feature-Based Image Sequence Representation for Visual Loop Closure Detection.

Topology Aware Object-Level Semantic Mapping Towards More Robust Loop Closure

Loop Closure Detection Based on Object-level Spatial Layout and Semantic Consistency

SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map