Abstract:Due to the development of the computer vision, machine learning, and deep learning technologies, the research community focuses not only on the traditional SLAM problems, such as geometric mapping and localization, but also on semantic SLAM. In this paper, we propose a Semantic SLAM system which builds the semantic maps with object-level entities, and it is integrated into the RGB-D SLAM framework. The system combines object detection module that is realized by the deep-learning method, and localization module with RGB-D SLAM seamlessly. In the proposed system, object detection module is used to perform object detection and recognition, and localization module is utilized to get the exact location of the camera. The two modules are integrated together to obtain the semantic maps of the environment. Furthermore, to improve the computational efficiency of the framework, an improved Octomap based on the Fast Line Rasterization Algorithm is constructed. Meanwhile, for the sake of accuracy and robustness of the semantic map, conditional random field is employed to do the optimization. Finally, we evaluate our Semantic SLAM through three different tasks, i.e., localization, object detection, and mapping. Specifically, the accuracy of localization and the mapping speed is evaluated on TUM data set. Compared with ORB-SLAM2 and original RGB-D SLAM, our system, respectively, got 72.9% and 91.2% improvements in dynamic environments localization evaluated by root-mean-square error. With the improved Octomap, the proposed Semantic SLAM is 66.5% faster than the original RGB-D SLAM. We also demonstrate the efficiency of object detection through quantitative evaluation in an automated inventory management task on a real-world data sets recorded over a realistic office.

Utilization of Semantic Planes: Improved Localization and Dense Semantic Map for Monocular SLAM in Urban Environment

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Semantic Object and Plane SLAM for RGB-D Cameras.

Monocular Semantic SLAM using Object-pose-graph Constraints

Semantic SLAM Based on Object Detection and Improved Octomap

Monocular Object and Plane SLAM in Structured Environments

Hybrid Semi-Dense 3D Semantic-Topological Mapping From Stereo Visual-Inertial Odometry SLAM With Loop Closure Detection

SDF-SLAM: A Deep Learning Based Highly Accurate SLAM Using Monocular Camera Aiming at Indoor Map Reconstruction with Semantic and Depth Fusion.

Semi-Dense 3D Semantic Mapping from Monocular SLAM

HI-SLAM: Monocular Real-time Dense Mapping with Hybrid Implicit Fields

A Monocular Visual SLAM System Augmented by Lightweight Deep Local Feature Extractor Using In-House and Low-Cost LIDAR-camera Integrated Device

A point-line-plane primitives fused localization and object-oriented semantic mapping in structural indoor scenes

Ds-Slam: A Semantic Visual Slam Towards Dynamic Environments

SLAM and 3D Semantic Reconstruction Based on the Fusion of Lidar and Monocular Vision

A 3D Semantic Visual SLAM in Dynamic Scenes

SemanticSLAM: Learning based Semantic Map Construction and Robust Camera Localization

Large-scale 3D Semantic Mapping Using Stereo Vision

3d Semantic Mapping Based On Convolutional Neural Networks

A semantic visual SLAM based on improved mask R-CNN in dynamic environment

Monocular Semantic Mapping Based on 3D Cuboids Tracking.

Dense 3D Semantic SLAM of traffic environment based on stereo vision