Abstract:Accurate and robust Simultaneous Localization and Mapping (SLAM) technology is a critical component of driverless cars, and semantic information plays a vital role in their analysis and understanding of the scene. In the actual scene, the moving object will produce the shadow phenomenon in the mapping process. The positioning accuracy and mapping effect will be affected. Therefore, we propose a semantic SLAM framework combining LiDAR, IMU, and camera, which includes a semantic fusion front-end odometry module and a closed-loop back-end optimization module based on semantic information. An improved image semantic segmentation algorithm based on Deeplabv3+ is designed to enhance the performance of the image semantic segmentation model by replacing the backbone network and introducing an attention mechanism to ensure the accuracy of point cloud segmentation. Dynamic objects are detected and eliminated by calculating the similarity score of semantic labels. A loop closure detection method based on semantic information is proposed to detect key semantic features and use threshold range detection and point cloud re-matching to establish the correct loop closure detection, and finally reduce the global cumulative error and improve the global trajectory accuracy using graph optimization to ultimately obtain the global motion trajectory and realize the construction of 3D semantic maps. We evaluated it on the KITTI dataset and collected a dataset for evaluation by ourselves, which includes four different sequences. The results show that the proposed framework has good positioning accuracy and mapping effect in large-scale urban road environments.

Sonar-Based Simultaneous Localization and Mapping Using the Semi-Direct Method

A robust stereo feature-aided semi-direct SLAM system

From Satellite to Ground: Satellite Assisted Visual Localization with Cross-view Semantic Matching

Robust Inertial-aided Underwater Localization and Navigation based on Imaging Sonar Keyframes

A Dense Subframe-based SLAM Framework with Side-scan Sonar

A Fully-automatic Side-scan Sonar SLAM Framework

Graph Matching for Underwater Simultaneous Localization and Mapping Using Multibeam Sonar Imaging

DRACo-SLAM: Distributed Robust Acoustic Communication-efficient SLAM for Imaging Sonar Equipped Underwater Robot Teams

Opti-Acoustic Semantic SLAM with Unknown Objects in Underwater Environments

An Underwater Multisensor Fusion Simultaneous Localization and Mapping System Based on Image Enhancement

FSD-SLAM: a fast semi-direct SLAM algorithm

AUV SLAM method based on SO-CFAR and ADT feature extraction

Semantic-Assisted LIDAR Tightly Coupled SLAM for Dynamic Environments

Underwater Slam Algorithm Based on Image Sonar Salient Target Detection

A Visual–Inertial Pressure Fusion-Based Underwater Simultaneous Localization and Mapping System

A Variable Radius Side Window Direct SLAM Method Based on Semantic Information

A Monocular Visual SLAM System Augmented by Lightweight Deep Local Feature Extractor Using In-House and Low-Cost LIDAR-camera Integrated Device

An Improved Underwater Visual SLAM through Image Enhancement and Sonar Fusion

SLAM and 3D Semantic Reconstruction Based on the Fusion of Lidar and Monocular Vision

RS-SLAM: Real time semantic slam with driverless car using LiDAR-Camera-IMU sensing

DSOMF: A Dynamic Environment Simultaneous Localization and Mapping Technique Based on Machine Learning