Abstract:One of the key challenges of visual Simultaneous Localization and Mapping (SLAM) in large-scale environments is how to effectively use global localization to correct the cumulative errors from long-term tracking. This challenge presents itself in two main aspects: first, the difficulty for robots in revisiting previous locations to perform loop closure, and second, the considerable memory resources required to maintain point-cloud-based global maps. Recent solutions have resorted into neural networks, using satellite images as the references for ground-level localization. However, most of these methods merely provide cross-view patch-matching results, which leads to unfeasible in integration with the SLAM system. To address these issues, we present a semantic-based cross-view localization method. This approach combines semantic information with a reward and penalty mechanism, enabling us to obtain a global probability map and achieve precise 3-degree-of-freedom (3-DoF) localization. Based on that, we develop a SLAM system that capitalizes on satellite imagery for global localization. This strategy effectively bridges the gap between SLAM and real-world coordinates while also substantially reducing accumulated errors. Our experimental results demonstrate that our global localization method significantly outperforms existing satellite-based systems. Moreover, in scenarios where the robot struggles to find loop closures, employing our localization method improves the SLAM accuracy.

Object SLAM Based on Spatial Layout and Semantic Consistency

Loop Closure Detection Based on Object-level Spatial Layout and Semantic Consistency

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Monocular SLAM for Large Scale Scenes

Monocular Semantic SLAM using Object-pose-graph Constraints

Robust Data Association for Object-level Semantic SLAM

SO-SLAM: Semantic Object SLAM with Scale Proportional and Symmetrical Texture Constraints

SLAM with Objects using a Nonparametric Pose Graph

Compositional Scalable Object SLAM

SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map

SA-LOAM: Semantic-aided LiDAR SLAM with Loop Closure

A real-time semantic visual SLAM approach with points and objects

Semantic Object and Plane SLAM for RGB-D Cameras.

An Object SLAM Framework for Association, Mapping, and High-Level Tasks

A point-line-plane primitives fused localization and object-oriented semantic mapping in structural indoor scenes

Global Localization with Object-Level Semantics and Topology

Semantic SLAM with Autonomous Object-Level Data Association

Topology Aware Object-Level Semantic Mapping Towards More Robust Loop Closure

Contour-SLAM: A Robust Object-Level SLAM Based on Contour Alignment

Monocular Semantic Mapping Based on 3D Cuboids Tracking.