Abstract:The research on loop closure detection has been carried out for the last many years; however, loop closure detection efficiency is still not that good and has been affected by many factors, including illumination conditions, weather conditions, seasons, and viewpoint changes. The research on loop closure detection from a different viewpoint is still an open research problem. The paper proposes an efficient solution to loop closure detection from different viewpoints by using landmarks instead of whole frames and taking the deep and robust features of deep learning instead of handcrafted features. A different kind of training approach is used to train the deep CNN to get highly abstract embeddings of input landmarks. The approach has many advantages over the traditional training approach and can solve many complex problems. This paper has used this approach to force similar or closer embeddings for similar landmarks and is forced to have a large gap in embeddings of different landmarks. The proposed method endeavors viewpoint invariant features, and the astonishing power of deep learning makes the features robust to viewpoint changes, occlusions, and illumination variations. The proposed visual SLAM system is tested on six publicly available datasets, and the results are compared with the most popular Bag of Words methods like DBoW2, DBoW3, and state-of-the-art deep learning methods AlexNet, ResNeXt, FlyNet, AFDPR and Siamese network. The results show that our method is efficient in finding loop closures candidates from different viewpoints. Code is available at https://github.com/IRMVLab/Step-wise-Learning.

VPD-Map: Visual Pointcloud Descriptor with Top-view Feature Map for Viewpoint-Free Loop Closure in Direct Visual Odometry

Efficient 3D LIDAR Based Loop Closing Using Deep Neural Network

Loop closure detection of visual SLAM based on variational autoencoder

SeqDLF: Deep Local Feature-Based Image Sequence Representation for Visual Loop Closure Detection.

VLAD-based Loop Closure Detection for Monocular SLAM.

Loop Closure Detection by Using Global and Local Features With Photometric and Viewpoint Invariance

PLSAV: Parallel Loop Searching and Verifying for Loop Closure Detection

Loop closure detection for visual SLAM systems using deep neural networks

Hybrid Semi-Dense 3D Semantic-Topological Mapping From Stereo Visual-Inertial Odometry SLAM With Loop Closure Detection

Adaptive bird's eye view description for long-term mapping and loop closure in 3D point clouds

SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map

ORD-WM: A two-stage loop closure detection algorithm for dense scenes

Semi-direct Monocular Visual and Visual-Inertial SLAM with Loop Closure Detection

Viewpoint-Invariant Loop Closure Detection Using Step-Wise Learning With Controlling Embeddings of Landmarks

Loop Closure Detection for Visual SLAM Fusing Semantic Information

Loop Closure Detection in SLAM by Combining Visual CNN Features and Submaps

Fast and robust loop-closure detection using deep neural networks and matrix transformation for a visual SLAM system

NDT-Map-Code: A 3D global descriptor for real-time loop closure detection in lidar SLAM