Abstract:Most visual simultaneous localization and mapping (SLAM) systems are based on the assumption of a static environment in autonomous vehicles. However, when dynamic objects, particularly vehicles, occupy a large portion of the image, the localization accuracy of the system decreases significantly. To mitigate this challenge, this paper unveils DOT-SLAM, a novel stereo visual SLAM system that integrates dynamic object tracking through graph optimization. By integrating dynamic object pose estimation into the SLAM system, the system can effectively utilize both foreground and background points for ego vehicle localization and obtain a static feature points map. To rectify the inaccuracies in depth estimation from stereo disparity directly on the foreground points of dynamic objects due to their self-similarity characteristics, a coarse-to-fine depth estimation method based on camera–road plane geometry is presented. This method uses rough depth to guide fine stereo matching, thereby obtaining the 3 dimensions (3D)spatial positions of feature points on dynamic objects. Subsequently, by establishing constraints on the dynamic object's pose using the road plane and non-holonomic constraints (NHCs) of the vehicle, reducing the initial pose uncertainty of dynamic objects leads to more accurate dynamic object initialization. Finally, by considering foreground points, background points, the local road plane, the ego vehicle pose, and dynamic object poses as optimization nodes, through the establishment and joint optimization of a nonlinear model based on graph optimization, accurate six degrees of freedom (DoFs) pose estimations are obtained for both the ego vehicle and dynamic objects. Experimental validation on the KITTI-360 dataset demonstrates that DOT-SLAM effectively utilizes features from the background and dynamic objects in the environment, resulting in more accurate vehicle trajectory estimation and a static environment map. Results obtained from a real-world dataset test reinforce the effectiveness.

DOTF-SLAM: Real-Time Dynamic SLAM Using Dynamic Odject Tracking and Key-Point Filtering

Dynamic SLAM: A Visual SLAM in Outdoor Dynamic Scenes

DMOT-SLAM: Visual SLAM in Dynamic Environments with Moving Object Tracking

Study on Slam Algorithm Based on Object Detection in Dynamic Scene

DOT-SLAM: A Stereo Visual Simultaneous Localization and Mapping (SLAM) System with Dynamic Object Tracking Based on Graph Optimization

Visual SLAM in dynamic environments based on object detection

RGB‐D SLAM with Moving Object Tracking in Dynamic Environments

Real-Time Dynamic SLAM Algorithm Based on Deep Learning

DynaTM-SLAM: Fast Filtering of Dynamic Feature Points and Object-Based Localization in Dynamic Indoor Environments

SVD-SLAM: Stereo Visual SLAM Algorithm Based on Dynamic Feature Filtering for Autonomous Driving

RT-SLAM:Real-Time Visual Dynamic Object Tracking SLAM

DO-SLAM: research and application of semantic SLAM system towards dynamic environments based on object detection

VSLAM Optimization Method in Dynamic Scenes Based on YOLO-Fastest

ADM-SLAM: Accurate and Fast Dynamic Visual SLAM with Adaptive Feature Point Extraction, Deeplabv3pro, and Multi-View Geometry

Real-time Visual SLAM based YOLO-Fastest for Dynamic Scenes

Robust Stereo Visual SLAM for Dynamic Environments With Moving Object

Real-Time SLAM Based on Dynamic Feature Point Elimination in Dynamic Environment

OMS-SLAM: Dynamic Scene Visual SLAM Based on Object Detection with Multiple Geometric Feature Constraints and Statistical Threshold Segmentation

Dynamic simultaneous localization and mapping based on object tracking in occluded environment

Dynamic SLAM with Multiple Information Constraint