Death threats for discrepancies over treatment data.

A. Burton

DOI: https://doi.org/10.1016/S1470-2045(07)70191-2

IF: 54.433

2007-07-01

The Lancet Oncology

Abstract:

What problem does this paper attempt to address?

LESS-Map: Lightweight and Evolving Semantic Map in Parking Lots for Long-term Self-Localization

MingRui Liu,Tang Xinyang,Qian Yeqiang,Chen Jiming,Li Liang

DOI: https://doi.org/10.1109/icra57147.2024.10610168

2024-01-01

Abstract:Precise and long-term stable localization is essential in parking lots for tasks like autonomous driving or autonomous valet parking, etc. Existing methods rely on a fixed and memory-inefficient map, which lacks robust data association approaches. And it is not suitable for precise localization or long-term map maintenance. In this paper, we propose a novel mapping, localization, and map update system based on ground semantic features, utilizing low-cost cameras. We present a precise and lightweight parameterization method to establish improved data association and achieve accurate localization at centimeter-level. Furthermore, we propose a novel map update approach by implementing high-quality data association for parameterized semantic features, allowing continuous map update and refinement during re-localization, while maintaining centimeter-level accuracy. We validate the performance of the proposed method in real-world experiments and compare it against state-of-the-art algorithms. The proposed method achieves an average accuracy improvement of 5cm during the registration process. The generated maps consume only a compact size of 450 KB/km and remain adaptable to evolving environments through continuous update.
Semantic-Assisted LIDAR Tightly Coupled SLAM for Dynamic Environments

Peng Liu,Yuxuan Bi,Jialin Shi,Tianyi Zhang,Caixia Wang

DOI: https://doi.org/10.1109/access.2024.3369183

IF: 3.9

2024-03-12

IEEE Access

Abstract:The Simultaneous Localization and Mapping (SLAM) environment is evolving from static to dynamic. However, traditional SLAM methods struggle to eliminate the influence of dynamic objects, leading to significant deviations in pose estimation. Addressing these challenges in dynamic environments, this paper introduces a semantic-assisted LIDAR tightly coupled SLAM method. Specifically, to mitigate interference from dynamic objects, a scheme for calculating static semantic probability is proposed. This enables the segmentation of static and dynamic points while eliminating both stationary dynamic objects and moving environmental blocking objects. Additionally, in point cloud feature extraction and matching processes, we incorporate constraint conditions based on semantic information to enhance accuracy and improve pose estimation precision. Furthermore, a semantic similarity constraint is included within the closed-loop factor module to significantly enhance positioning accuracy and facilitate the construction of maps with higher global consistency. Experimental results from KITTI and M2DGR datasets demonstrate that our method exhibits generalization ability towards unknown data while effectively mitigating dynamic interference in real-world environments. Compared with current state-of-the-art methods, our approach achieves notable improvements in both accuracy and robustness.

computer science, information systems,telecommunications,engineering, electrical & electronic
A Method of Vision Aided GNSS Positioning Using Semantic Information in Complex Urban Environment

Rui Zhai,Yunbin Yuan

DOI: https://doi.org/10.3390/rs14040869

IF: 5

2022-02-11

Remote Sensing

Abstract:High-precision localization through multi-sensor fusion has become a popular research direction in unmanned driving. However, most previous studies have performed optimally only in open-sky conditions; therefore, high-precision localization in complex urban environments required an urgent solution. The complex urban environments employed in this study include dynamic environments, which result in limited visual localization performance, and highly occluded environments, which yield limited global navigation satellite system (GNSS) performance. In order to provide high-precision localization in these environments, we propose a vision-aided GNSS positioning method using semantic information by integrating stereo cameras and GNSS into a loosely coupled navigation system. To suppress the effect of dynamic objects on visual positioning accuracy, we propose a dynamic-simultaneous localization and mapping (Dynamic-SLAM) algorithm to extract semantic information from images using a deep learning framework. For the GPS-challenged environment, we propose a semantic-based dynamic adaptive Kalman filtering fusion (S-AKF) algorithm to develop vision aided GNSS and achieve stable and high-precision positioning. Experiments were carried out in GNSS-challenged environments using the open-source KITTI dataset to evaluate the performance of the proposed algorithm. The results indicate that the dynamic-SLAM algorithm improved the performance of the visual localization algorithm and effectively suppressed the error spread of the visual localization algorithm. Additionally, after vision was integrated, the loosely-coupled navigation system achieved continuous high-accuracy positioning in GNSS-challenged environments.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
Dynamic SLAM: A Visual SLAM in Outdoor Dynamic Scenes

Shuhuan Wen,Xiongfei Li,Xin Liu,Jiaqi Li,Sheng Tao,Yidan Long,Tony Qiu

DOI: https://doi.org/10.1109/tim.2023.3317378

IF: 5.6

2023-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:Simultaneous localization and mapping (SLAM) has been widely used in augmented reality (AR), virtual reality (VR), robotics, and autonomous vehicles as the theoretical basis for robots to perceive their environment. Most popular SLAM algorithms assume that objects in the scene are static. Solving dynamic problems in SLAM is now attracting increasing attention. In this article, we propose a method that combines semantic segmentation information and spatial motion information of associated pixels to cope with dynamic objects based on ORB-SLAM2. We add a deep segmentation network SegNet to segment input image and obtain the semantic information for each feature point. Next, the spatial velocity of feature points between adjacent frames is calculated assuming uniform motion. Finally, the two parts are fused for the final judgment, and the dynamic feature points are removed to improve positioning accuracy. We evaluate our SLAM algorithms using the public KITTI dataset. The proposed algorithm has a similar overall accuracy level to ORB-SLAM2, but it is more accurate in sequences with many dynamic objects. On KITTI’s raw data sequence containing multiple dynamic objects, our pipeline achieves the best performance, improving 39.5% compared with the original ORB-SLAM2 system. We compare our algorithm with other state-of-the-art SLAM systems used to cope with dynamic environments. The results show that the proposed algorithm has a better performance.

engineering, electrical & electronic,instruments & instrumentation
DRV-SLAM: An Adaptive Real-Time Semantic Visual SLAM Based on Instance Segmentation Toward Dynamic Environments

Qiang Ji,Zikang Zhang,Yifu Chen,Enhui Zheng

DOI: https://doi.org/10.1109/access.2024.3379269

IF: 3.9

2024-03-30

IEEE Access

Abstract:Traditional simultaneous localization and mapping (SLAM) methodologies predominantly rely on the assumption of a static environment. This constraint limits the applicability of most visual SLAM systems in various real-world scenarios. In this paper, we introduce a real-time semantic visual SLAM algorithm tailored for complex dynamic environments (DRV-SLAM). DRV-SLAM leverages image analysis to identify potential moving objects and determine their current motion states. By dynamically adjusting the rejection of unreliable dynamic feature points based on the proportion of potential moving objects in the environment, DRV-SLAM significantly enhances the system's localization accuracy and robustness in complex dynamic environments. Additionally, DRV-SLAM employs a dense mapping approach that combines global downsampling and targeted object data enhancement. This method effectively reduces the memory footprint of dense point cloud maps, enabling DRV-SLAM to efficiently construct large-scale dense point cloud maps in diverse scenarios. Experimental results show that in a highly dynamic environment, the DRV-SLAM algorithm shows an order of magnitude performance improvement compared to the traditional ORB-SLAM2 algorithm. The performance index of absolute trajectory error is significantly improved by more than 98%, and DRV-SLAM is currently one of the most real-time, accurate and robust systems for dynamic scenes.

computer science, information systems,telecommunications,engineering, electrical & electronic
ADS-SLAM: a semantic SLAM based on adaptive motion compensation and semantic information for dynamic environments

Jun Dai,Minghao Yang,Yanqin Li,Jun Wei Zhao,Naohiko Hanajima

DOI: https://doi.org/10.1088/1361-6501/ad824b

IF: 2.398

2024-10-03

Measurement Science and Technology

Abstract:Static environment assumption are the prerequisite for simultaneous localization and mapping (SLAM), while interference from dynamic objects in the environment can seriously impair the system's localization accuracy. Recently, many works usually combine deep learning and geometric constraints to attenuate the interference of dynamic objects, however poor real-time performance and low accuracy in high dynamic scenes still exist. In this paper, we proposed a semantic SLAM algorithm for complex dynamic scenes named ADS-SLAM. Our system combines the advantages of semantic information and motion constraints to remove dynamic points during tracking and localization. First, an adaptive dynamic point detection method based on epipolar constraint between adjacent frames is designed to adapt the changes of object motion states, and a motion area detection method based on Gaussian Mixture Model (GMM) and Kalman Filter (KF) is utilized to effectively compensate the missed motion areas. Second, the object detection network with improved inference in the backend is utilized to extract prior object semantics. Lastly, the multi-level information is integrated in order to comprehensively screen all dynamic points in the environment and utilize only static points for pose estimation and optimization. Extensive evaluations on challenging public datasets and outdoor dynamic environment demonstrate that our algorithm achieves high localization accuracy in almost all dynamic scenarios compared to the current state-of-the-art SLAM algorithms, especially the highest accuracy in high dynamic scenarios, and shows real-time performance for practical applications.

engineering, multidisciplinary,instruments & instrumentation
A real-time semantic visual SLAM for dynamic environment based on deep learning and dynamic probabilistic propagation

Liang Chen,Zhi Ling,Yu Gao,Rongchuan Sun,Sheng Jin

DOI: https://doi.org/10.1007/s40747-023-01031-5

IF: 6.7

2023-03-30

Complex & Intelligent Systems

Abstract:Abstract Most existing visual simultaneous localization and mapping (SLAM) algorithms rely heavily on the static world assumption. Combined with deep learning, semantic SLAM has become a popular solution for dynamic scenes. However, most semantic SLAM methods show poor real-time performance when dealing with dynamic scenes. To handle this problem, a real-time semantic SLAM method is proposed in this paper, combining knowledge distillation and dynamic probability propagation strategy. First, to improve the execution speed, a multi-level knowledge distillation method is adopted to obtain a lightweight segmentation model, which is more suitable for continuous frames to create an independent semantic segmentation thread. This segmentation thread only accepts keyframes as input so that the system can avoid time delay caused by processing each frame. Second, a static semantic keyframe selection strategy is proposed based on the segmentation results. In this way, those keyframes containing more static information will be selected to reduce the participation of dynamic objects. By combining segmentation results and data matching algorithm, our system can realize the update and propagation of dynamic probability, reducing the influence of dynamic points in the pose optimization process. Validation results based on the KITTI and TUM datasets show that our method can effectively deal with dynamic feature points and improve running speed simultaneously.

computer science, artificial intelligence
A semantic visual SLAM based on improved mask R-CNN in dynamic environment

Kang Zhang,Chaoyi Dong,Hongfei Guo,Qifan Ye,Liangliang Gao,Shuai Xiang,Xiaoyan Chen,Yi Wu

DOI: https://doi.org/10.1017/s0263574724001553

IF: 2.7

2024-10-05

Robotica

Abstract:To address the issues of low positioning accuracy and weak robustness of prior visual simultaneous localization and mapping (VSLAM) systems in dynamic environments, a semantic VSLAM (Sem-VSLAM) approach based on deep learning is proposed in this article. The proposed Sem-VSLAM algorithm adds semantic segmentation threads in parallel based on the open-source ORB-SLAM2's visual odometry. First, while extracting the ORB features from an RGB-D image, the frame image is semantically segmented, and the segmented results are detected and repaired. Then, the feature points of dynamic objects are eliminated by using semantic information and motion consistency detection, and the poses are estimated by using the remaining feature points after the dynamic feature elimination. Finally, a 3D point cloud map is constructed by using tracking information and semantic information. The experiment uses Technical University of Munich public data to show the usefulness of the Sem-VSLAM algorithm. The experimental results show that the Sem-VSLAM algorithm can reduce the absolute trajectory error and relative attitude error of attitude estimation by about 95% compared to the ORB-SLAM2 algorithm and by about 14% compared to the VO-YOLOv5s in a highly dynamic environment and the average time consumption of tracking each frame image reaches 61 ms. It is verified that the Sem-VSLAM algorithm effectively improves the robustness and positioning accuracy in high dynamic environment and owning a satisfying real-time performance. Therefore, the Sem-VSLAM has a better mapping effect in a highly dynamic environment.

robotics
LOCALIZATION AND MAPPING IN DYNAMIC ENVIRONMENT USING MOVING OBJECTS SEGMENTATION FOR AUTONOMOUS DRIVING

Bo Wang,Hong Bao,Cheng Xu

2019-01-01

Abstract:Simultaneous localization and mapping (SLAM) is a key technology for localization in autonomous vehicles. This method only applies to the static environment; it limits the application of dynamic urban environments that contain many vehicles and pedestrians. In this paper we propose a visual SLAM system for dynamic urban environments. It has the capabilities of dynamic objects segmentation and removal. Localization and mapping are implemented by ORB-SLAM2. The difference is that we have a special pre-processing of the input images. We use instance-aware semantic segmentation to detect the objects, such as cars. Then use sparse optical flow to classify moving moving objects and potentially moving objects, such as driving cars and parked cars. The moving objects are removed directly, and potentially moving objects are utilized in the pose estimation section, but their corresponding landmarks are deleted in the mapping section, which is useful for loop-closure detection and relocalization. We evaluate our system on the public KITTI and TUM dataset. The results demonstrate that our system can work in highly dynamic urban environments and outperforms the accuracy of the state-ofthe-art visual SLAM system.
Real-Time Visual-Inertial Localization Using Semantic Segmentation Towards Dynamic Environments

Xinyang Zhao,Changhong Wang,Marcelo H. Ang

DOI: https://doi.org/10.1109/access.2020.3018557

IF: 3.9

2020-01-01

IEEE Access

Abstract:Simultaneous localization and mapping(SLAM), focusing on addressing the joint estimation problem of self-localization and scene mapping, has been widely used in many applications such as mobile robot, drone, and augmented reality(AR). However, traditional state-of-the-art SLAM approaches are typically designed under the static-world assumption and prone to be degraded by moving objects when running in dynamic scenes. This article presents a novel semantic visual-inertial SLAM system for dynamic environments that, building on VINS-Mono, performs real-time trajectory estimation by utilizing the pixel-wise results of semantic segmentation. We integrate the feature tracking and extraction framework into the front-end of the SLAM system, which could make full use of the time waiting for the completion of the semantic segmentation module, to effectively track the feature points on subsequent images from the camera. In this way, the system can track feature points stably even in high-speed movement. We also construct the dynamic feature detection module that combines the pixel-wise semantic segmentation results and the multi-view geometric constraints to exclude dynamic feature points. We evaluate our system in public datasets, including dynamic indoor scenes and outdoor scenes. Several experiments demonstrate that our system could achieve higher localization accuracy and robustness than state-of-the-art SLAM systems in challenging environments.

computer science, information systems,telecommunications,engineering, electrical & electronic
A Real-Time Dynamic SLAM Algorithm Based on the Fusion of Visual, Inertial, and Semantic Information

Yinglong Wang,Xiaoxiong Liu,Minkun Zhao,Xinlong Xu

DOI: https://doi.org/10.3390/ijgi13050163

IF: 3.4

2024-05-14

ISPRS International Journal of Geo-Information

Abstract:A deep learning-based Visual Inertial SLAM technique is proposed in this paper to ensure accurate autonomous localization of mobile robots in environments with dynamic objects. Addressing the limitations of real-time performance in deep learning algorithms and the poor robustness of pure visual geometry algorithms, this paper presents a deep learning-based Visual Inertial SLAM technique. Firstly, a non-blocking model is designed to extract semantic information from images. Then, a motion probability hierarchy model is proposed to obtain prior motion probabilities of feature points. For image frames without semantic information, a motion probability propagation model is designed to determine the prior motion probabilities of feature points. Furthermore, considering that the output of inertial measurements is unaffected by dynamic objects, this paper integrates inertial measurement information to improve the estimation accuracy of feature point motion probabilities. An adaptive threshold-based motion probability estimation method is proposed, and finally, the positioning accuracy is enhanced by eliminating feature points with excessively high motion probabilities. Experimental results demonstrate that the proposed algorithm achieves accurate localization in dynamic environments while maintaining real-time performance.

geography, physical,remote sensing,computer science, information systems
RS-SLAM: Real time semantic slam with driverless car using LiDAR-Camera-IMU sensing

Chuanwei Zhang,Ruiqi Zhao,Peilin Qin,Jiajia Yang

DOI: https://doi.org/10.1088/1402-4896/ad7a30

2024-09-14

Physica Scripta

Abstract:Accurate and robust Simultaneous Localization and Mapping (SLAM) technology is a critical component of driverless cars, and semantic information plays a vital role in their analysis and understanding of the scene. In the actual scene, the moving object will produce the shadow phenomenon in the mapping process. The positioning accuracy and mapping effect will be affected. Therefore, we propose a semantic SLAM framework combining LiDAR, IMU, and camera, which includes a semantic fusion front-end odometry module and a closed-loop back-end optimization module based on semantic information. An improved image semantic segmentation algorithm based on Deeplabv3+ is designed to enhance the performance of the image semantic segmentation model by replacing the backbone network and introducing an attention mechanism to ensure the accuracy of point cloud segmentation. Dynamic objects are detected and eliminated by calculating the similarity score of semantic labels. A loop closure detection method based on semantic information is proposed to detect key semantic features and use threshold range detection and point cloud re-matching to establish the correct loop closure detection, and finally reduce the global cumulative error and improve the global trajectory accuracy using graph optimization to ultimately obtain the global motion trajectory and realize the construction of 3D semantic maps. We evaluated it on the KITTI dataset and collected a dataset for evaluation by ourselves, which includes four different sequences. The results show that the proposed framework has good positioning accuracy and mapping effect in large-scale urban road environments.

physics, multidisciplinary
SCE-SLAM: a real-time semantic RGBD SLAM system in dynamic scenes based on spatial coordinate error

Shiyu Song,Wenbo Hou,Yujiang Zhong,Liumingyuan Zhang,Ji Chen,W. Zhang

DOI: https://doi.org/10.1088/1361-6501/aceb7e

IF: 2.398

2023-07-28

Measurement Science and Technology

Abstract:Simultaneous localization and mapping (SLAM) is one of the prerequisite technologies for intelligent mobile robots to accomplish various tasks in unknown environments. In recent years, many excellent SLAM systems have emerged, but most of them have a basic assumption that the environment is static, which results in their poor performance in dynamic environments. To solve this problem, this paper presents SCE-SLAM: a novel real-time semantic RGB-D SLAM system that is built on the RGB-D mode of ORB-SLAM3. SCE-SLAM tightly combines semantic and geometric information. Considering the real-time requirements, the semantic module provides semantic prior knowledge for the geometric module using the latest and fastest object detection network YOLOv7. Then, a new geometric constraint method is proposed to filter dynamic feature points. This method takes full advantage of depth images and semantic information to recover three-dimensional (3D) feature points and the initial camera pose. A 3D coordinate error is used as a threshold, and SCE-SLAM removes dynamic points using the K-means clustering algorithm. In this way, SCE-SLAM effectively reduces the impact of dynamic points. Furthermore, we validate SCE-SLAM with challenging dynamic sequences of the TUM dataset. The results demonstrate that SCE-SLAM significantly improves the localization accuracy and system robustness in all kinds of dynamic environments.

Engineering,Computer Science,Physics
Probabilistic Data Association for Semantic SLAM at Scale

Elad Michael,Tyler Summers,Tony A. Wood,Chris Manzie,Iman Shames

DOI: https://doi.org/10.48550/arXiv.2202.12802

IF: 3.7

2022-02-25

Robotics

Abstract:With advances in image processing and machine learning, it is now feasible to incorporate semantic information into the problem of simultaneous localisation and mapping (SLAM). Previously, SLAM was carried out using lower level geometric features (points, lines, and planes) which are often view-point dependent and error prone in visually repetitive environments. Semantic information can improve the ability to recognise previously visited locations, as well as maintain sparser maps for long term SLAM applications. However, SLAM in repetitive environments has the critical problem of assigning measurements to the landmarks which generated them. In this paper, we use k-best assignment enumeration to compute marginal assignment probabilities for each measurement landmark pair, in real time. We present numerical studies on the KITTI dataset to demonstrate the effectiveness and speed of the proposed framework.
Semantic visual simultaneous localization and mapping (SLAM) using deep learning for dynamic scenes

Xiao Ya Zhang,Abdul Hadi Abd Rahman,Faizan Qamar

DOI: https://doi.org/10.7717/peerj-cs.1628

2023-10-11

PeerJ Computer Science

Abstract:Simultaneous localization and mapping (SLAM) is a fundamental problem in robotics and computer vision. It involves the task of a robot or an autonomous system navigating an unknown environment, simultaneously creating a map of the surroundings, and accurately estimating its position within that map. While significant progress has been made in SLAM over the years, challenges still need to be addressed. One prominent issue is robustness and accuracy in dynamic environments, which can cause uncertainties and errors in the estimation process. Traditional methods using temporal information to differentiate static and dynamic objects have limitations in accuracy and applicability. Nowadays, many research trends have leaned towards utilizing deep learning-based methods which leverage the capabilities to handle dynamic objects, semantic segmentation, and motion estimation, aiming to improve accuracy and adaptability in complex scenes. This article proposed an approach to enhance monocular visual odometry's robustness and precision in dynamic environments. An enhanced algorithm using the semantic segmentation algorithm DeeplabV3+ is used to identify dynamic objects in the image and then apply the motion consistency check to remove feature points belonging to dynamic objects. The remaining static feature points are then used for feature matching and pose estimation based on ORB-SLAM2 using the Technical University of Munich (TUM) dataset. Experimental results show that our method outperforms traditional visual odometry methods in accuracy and robustness, especially in dynamic environments. By eliminating the influence of moving objects, our method improves the accuracy and robustness of visual odometry in dynamic environments. Compared to the traditional ORB-SLAM2, the results show that the system significantly reduces the absolute trajectory error and the relative pose error in dynamic scenes. Our approach has significantly improved the accuracy and robustness of the SLAM system's pose estimation.

computer science, information systems, artificial intelligence, theory & methods
Dynamic-SLAM: Semantic monocular visual localization and mapping based on deep learning in dynamic environment

Linhui Xiao,Jinge Wang,Xiaosong Qiu,Zheng Rong,Xudong Zou

DOI: https://doi.org/10.1016/j.robot.2019.03.012

IF: 3.7

2019-07-01

Robotics and Autonomous Systems

Abstract:When working in dynamic environment, traditional SLAM framework performs poorly due to interference from dynamic objects. By taking advantages of deep learning in object detection, a semantic simultaneous localization and mapping framework named Dynamic-SLAM is proposed, in order to solve the problem of SLAM in dynamic environment. First, based on the convolutional neural network, an SSD object detector which combines prior knowledge is constructed to detect dynamic objects in the newly detection thread at semantic level. Then, in view of low recall rate of the existing SSD object detection network, a missed detection compensation algorithm based on the speed invariance in adjacent frames is proposed, which greatly improves the recall rate of detection. Finally, a feature-based visual SLAM system is constructed, which processes the feature points of dynamic objects through a selective tracking algorithm in the tracking thread, to significantly reduce the error of pose estimation caused by incorrect matching. The recall rate of the system is increased from 82.3% to 99.8% compared with the original SSD network. Several experiments show that the localization accuracy of Dynamic-SLAM is higher than the state-of-the-art systems. The system successfully localizes and constructs an accurate environmental map in real-world dynamic environment by using a mobile robot. In sum, our experimental demonstrations verify that Dynamic-SLAM shows improved accuracy and robustness in robot localization and mapping comparing to the state-of-the-art SLAM system in dynamic environment.

robotics,automation & control systems,computer science, artificial intelligence
DCS-SLAM: A Semantic SLAM with Moving Cluster towards Dynamic Environments.

Jiacheng Zhang,Mingyu Gao,Zhiwei He,Yuxiang Yang

DOI: https://doi.org/10.1109/ROBIO55434.2022.10011980

2022-01-01

Abstract:Semantic SLAM, which can greatly improve tracking performance in highly dynamic scenes and construct dense maps with semantic information, has gained a lot of attention recently. However, it remains a challenge to obtain rich semantic information while ensuring real-time tracking. In this paper, we propose a new semantic SLAM framework, called DCS-SLAM, which uses the Moving Cluster association and MapPoint's motion probability propagation to solve this problem. Specifically, a novel data communication method is devised to obtain the Moving Cluster for each frame in a low-cost way by fully integrating geometric information and asynchronous semantic information. Besides, the Bayesian probability transfer model of MapPoint is applied to further remove the motion points. Experimental results will demon-strate that our framework has better computational efficiency while guaranteeing absolute trajectory accuracy. Moreover, our DCS-SLAM can achieve dense static map construction with rich semantic information by effectively removing the dynamic objects.
Semantic stereo visual SLAM toward outdoor dynamic environments based on ORB-SLAM2

Yawen Li,Guangming Song,Shuang Hao,Juzheng Mao,Aiguo Song

DOI: https://doi.org/10.1108/ir-09-2022-0236

2023-01-26

Industrial Robot

Abstract:Purpose The prerequisite for most traditional visual simultaneous localization and mapping (V-SLAM) algorithms is that most objects in the environment should be static or in low-speed locomotion. These algorithms rely on geometric information of the environment and restrict the application scenarios with dynamic objects. Semantic segmentation can be used to extract deep features from images to identify dynamic objects in the real world. Therefore, V-SLAM fused with semantic information can reduce the influence from dynamic objects and achieve higher accuracy. This paper aims to present a new semantic stereo V-SLAM method toward outdoor dynamic environments for more accurate pose estimation. Design/methodology/approach First, the Deeplabv3+ semantic segmentation model is adopted to recognize semantic information about dynamic objects in the outdoor scenes. Second, an approach that combines prior knowledge to determine the dynamic hierarchy of moveable objects is proposed, which depends on the pixel movement between frames. Finally, a semantic stereo V-SLAM based on ORB-SLAM2 to calculate accurate trajectory in dynamic environments is presented, which selects corresponding feature points on static regions and eliminates useless feature points on dynamic regions. Findings The proposed method is successfully verified on the public data set KITTI and ZED2 self-collected data set in the real world. The proposed V-SLAM system can extract the semantic information and track feature points steadily in dynamic environments. Absolute pose error and relative pose error are used to evaluate the feasibility of the proposed method. Experimental results show significant improvements in root mean square error and standard deviation error on both the KITTI data set and an unmanned aerial vehicle. That indicates this method can be effectively applied to outdoor environments. Originality/value The main contribution of this study is that a new semantic stereo V-SLAM method is proposed with greater robustness and stability, which reduces the impact of moving objects in dynamic scenes.
Real-Time Dynamic SLAM Algorithm Based on Deep Learning

Peng Su,Suyun Luo,Xiaoci Huang

DOI: https://doi.org/10.1109/access.2022.3199350

IF: 3.9

2022-09-04

IEEE Access

Abstract:In the traditional visual simultaneous localization and mapping (SLAM), the strong static assumption leads to a large degradation in the accuracy of visual SLAM in dynamic environments. For this reason, many scholars incorporate semantic segmentation networks into the visual SLAM framework to extract dynamic information in images. However, most semantic segmentation networks consume a lot of computing time due to the large model size, which leads to the algorithm's inability to meet real-time requirements in practical applications. In this paper, a real-time visual SLAM algorithm based on deep learning is proposed. This novel algorithm is based on ORB-SLAM2, and a parallel semantic thread based on the lightweight object detection network YOLOv5s is designed, which enables us to get semantic information in the scene more quickly. In the tracking thread, an optimized homography matrix module is proposed, which utilizes semantic information to optimize and solve the homography matrix so that we can calculate a more accurate optical flow vector. In the optical flow module, the semantic information is used to narrow down the calculation range of the optical flow value to improve the real-time performance of the system, and the dynamic feature points in the image are removed by the optical flow mask to improve the accuracy of the system. Experimental results show that compared with ORB-SLAM2, DynaSLAM, and other excellent visual SLAM algorithms, this algorithm can effectively reduce the absolute trajectory error of visual SLAM in dynamic environments. Compared with other deep learning-based visual SLAM algorithms, the real-time performance of this algorithm is also significantly improved.

computer science, information systems,telecommunications,engineering, electrical & electronic

Death threats for discrepancies over treatment data.

LESS-Map: Lightweight and Evolving Semantic Map in Parking Lots for Long-term Self-Localization

Semantic-Assisted LIDAR Tightly Coupled SLAM for Dynamic Environments

A Method of Vision Aided GNSS Positioning Using Semantic Information in Complex Urban Environment

Dynamic SLAM: A Visual SLAM in Outdoor Dynamic Scenes

DRV-SLAM: An Adaptive Real-Time Semantic Visual SLAM Based on Instance Segmentation Toward Dynamic Environments

ADS-SLAM: a semantic SLAM based on adaptive motion compensation and semantic information for dynamic environments

A real-time semantic visual SLAM for dynamic environment based on deep learning and dynamic probabilistic propagation

A semantic visual SLAM based on improved mask R-CNN in dynamic environment

LOCALIZATION AND MAPPING IN DYNAMIC ENVIRONMENT USING MOVING OBJECTS SEGMENTATION FOR AUTONOMOUS DRIVING

Real-Time Visual-Inertial Localization Using Semantic Segmentation Towards Dynamic Environments

A Real-Time Dynamic SLAM Algorithm Based on the Fusion of Visual, Inertial, and Semantic Information

RS-SLAM: Real time semantic slam with driverless car using LiDAR-Camera-IMU sensing

SCE-SLAM: a real-time semantic RGBD SLAM system in dynamic scenes based on spatial coordinate error

Probabilistic Data Association for Semantic SLAM at Scale

Semantic visual simultaneous localization and mapping (SLAM) using deep learning for dynamic scenes

Dynamic-SLAM: Semantic monocular visual localization and mapping based on deep learning in dynamic environment

DCS-SLAM: A Semantic SLAM with Moving Cluster towards Dynamic Environments.

Semantic stereo visual SLAM toward outdoor dynamic environments based on ORB-SLAM2

Real-Time Dynamic SLAM Algorithm Based on Deep Learning