Abstract:Visual SLAM (VSLAM) has been developing rapidly due to its advantages of low-cost sensors, the easy fusion of other sensors, and richer environmental information. Traditional visionbased SLAM research has made many achievements, but it may fail to achieve wished results in challenging environments. Deep learning has promoted the development of computer vision, and the combination of deep learning and SLAM has attracted more and more attention. Semantic information, as high-level environmental information, can enable robots to better understand the surrounding environment. This paper introduces the development of VSLAM technology from two aspects: traditional VSLAM and semantic VSLAM combined with deep learning. For traditional VSLAM, we summarize the advantages and disadvantages of indirect and direct methods in detail and give some classical VSLAM open-source algorithms. In addition, we focus on the development of semantic VSLAM based on deep learning. Starting with typical neural networks CNN and RNN, we summarize the improvement of neural networks for the VSLAM system in detail. Later, we focus on the help of target detection and semantic segmentation for VSLAM semantic information introduction. We believe that the development of the future intelligent era cannot be without the help of semantic technology. Introducing deep learning into the VSLAM system to provide semantic information can help robots better perceive the surrounding environment and provide people with higher-level help.

Deep ViDAR：CNN Based 360°panoramic Video System for Outdoor Robot Visual Navigation and SLAM

Semantic Visual Odometry Based on Panoramic Annular Imaging

Design of an Enhanced Visual Odometry by Building and Matching Compressive Panoramic Landmarks Online

Aerial-PASS: Panoramic Annular Scene Segmentation in Drone Videos

Real-Time Panoramic System for Underwater Cleaning Robot

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Stereo Vision Based SLAM in Outdoor Environments

Multi-camera visual SLAM for off-road navigation

Real-time Multi-view Omnidirectional Depth Estimation System for Robots and Autonomous Driving on Real Scenes

A Visual SLAM System Based on the Panoramic Camera

Semi-Dense 3D Semantic Mapping from Monocular SLAM

360ORB-SLAM: A Visual SLAM System for Panoramic Images with Depth Completion Network

A Novel Lidar-Assisted Monocular Visual SLAM Framework for Mobile Robots in Outdoor Environments

A semantic SLAM-based dense mapping approach for large-scale dynamic outdoor environment

Large-Scale 3D Semantic Mapping Using Monocular Vision

A Survey of Deep Learning Application in Dynamic Visual SLAM

An Overview on Visual SLAM: From Tradition to Semantic

Building and optimization of 3D semantic map based on Lidar and camera fusion

SBC-SLAM: Semantic Bioinspired Collaborative SLAM for Large-Scale Environment Perception of Heterogeneous Systems