Abstract:Visual simultaneous localization and mapping (VSLAM) enhances the navigation of autonomous agents in unfamiliar environments by progressively constructing maps and estimating poses. However, conventional VSLAM pipelines often exhibited degraded performance in dynamic environments featuring mobile objects. Recent research in deep learning led to notable progress in semantic segmentation, which involves assigning semantic labels to image pixels. The integration of semantic segmentation into VSLAM can effectively differentiate between static and dynamic elements in intricate scenes. This paper provided a comprehensive comparative review on leveraging semantic segmentation to improve major components of VSLAM, including visual odometry, loop closure detection, and environmental mapping. Key principles and methods for both traditional VSLAM and deep semantic segmentation were introduced. This paper presented an overview and comparative analysis of the technical implementations of semantic integration across various modules of the VSLAM pipeline. Furthermore, it examined the features and potential use cases associated with the fusion of VSLAM and semantics. It was found that the existing VSLAM model continued to face challenges related to computational complexity. Promising future research directions were identified, including efficient model design, multimodal fusion, online adaptation, dynamic scene reconstruction, and end-to-end joint optimization. This review shed light on the emerging paradigm of semantic VSLAM and how deep learning-enabled semantic reasoning could unlock new capabilities for autonomous intelligent systems to operate reliably in the real world.

A Brief Comparison of Deep Learning Methods for Semantic Segmentation.

Image Semantic Segmentation Based on Region and Deep Residual Network

Recent Progress in Semantic Image Segmentation

A Brief Survey on Semantic Segmentation with Deep Learning

A review of semantic segmentation using deep neural networks

A Survey of Image Semantic Segmentation Algorithm Based on Deep Learning

Review the state-of-the-art technologies of semantic segmentation based on deep learning

A Review on Deep Learning Techniques Applied to Semantic Segmentation

Deep-Learning-Based Approaches for Semantic Segmentation of Natural Scene Images: A Review

A survey of semi- and weakly supervised semantic segmentation of images

Methods and datasets on semantic segmentation: A review

A Review on Deep Learning Approaches to Image Classification and Object Segmentation

Overview of Image Semantic Segmentation Technology

Intelligent Image Semantic Segmentation: A Review Through Deep Learning Techniques for Remote Sensing Image Analysis

Deep-Learning-Based Point Cloud Semantic Segmentation: A Survey

A Survey on Deep Learning-based Architectures for Semantic Segmentation on 2D images

Medical Image Semantic Segmentation Based on Deep Learning

A Survey on Semantic Segmentation.

A brief survey on RGB-D semantic segmentation using deep learning

A Comparative Review on Enhancing Visual Simultaneous Localization and Mapping with Deep Semantic Segmentation

Deep Learning-Based Semantic Segmentation of Remote Sensing Images: a Review