Abstract:Most visual simultaneous localization and mapping (SLAM) systems are based on the assumption of a static environment in autonomous vehicles. However, when dynamic objects, particularly vehicles, occupy a large portion of the image, the localization accuracy of the system decreases significantly. To mitigate this challenge, this paper unveils DOT-SLAM, a novel stereo visual SLAM system that integrates dynamic object tracking through graph optimization. By integrating dynamic object pose estimation into the SLAM system, the system can effectively utilize both foreground and background points for ego vehicle localization and obtain a static feature points map. To rectify the inaccuracies in depth estimation from stereo disparity directly on the foreground points of dynamic objects due to their self-similarity characteristics, a coarse-to-fine depth estimation method based on camera–road plane geometry is presented. This method uses rough depth to guide fine stereo matching, thereby obtaining the 3 dimensions (3D)spatial positions of feature points on dynamic objects. Subsequently, by establishing constraints on the dynamic object's pose using the road plane and non-holonomic constraints (NHCs) of the vehicle, reducing the initial pose uncertainty of dynamic objects leads to more accurate dynamic object initialization. Finally, by considering foreground points, background points, the local road plane, the ego vehicle pose, and dynamic object poses as optimization nodes, through the establishment and joint optimization of a nonlinear model based on graph optimization, accurate six degrees of freedom (DoFs) pose estimations are obtained for both the ego vehicle and dynamic objects. Experimental validation on the KITTI-360 dataset demonstrates that DOT-SLAM effectively utilizes features from the background and dynamic objects in the environment, resulting in more accurate vehicle trajectory estimation and a static environment map. Results obtained from a real-world dataset test reinforce the effectiveness.

Online Object Detection and Localization on Stereo Visual SLAM System

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

Stereo Vision Based SLAM in Outdoor Environments

A robust stereo feature-aided semi-direct SLAM system

A Robust Multi-Object Tracking SLAM System in Dynamic Scenes for Stereo and RGB-D Cameras

Stereo Visual Inertial SLAM with Semi-direct Residual

Dynamic SLAM System Based on Object Detection

Stereo SLAM in Dynamic Environments Using Semantic Segmentation

Fast Direct Stereo Visual SLAM

Visual SLAM in dynamic environments based on object detection

DyStSLAM: An Efficient Stereo Vision SLAM System in Dynamic Environment

Stereo and LiDAR Loosely Coupled SLAM Constrained Ground Detection

Robust Stereo Visual SLAM for Dynamic Environments With Moving Object

A Stereo Vision SLAM with Moving Vehicles Tracking in Outdoor Environment

Visual SLAM with Multi-Object Tracking Using Hybrid Features

CD-SLAM:A Real-Time Stereo Visual-Inertial SLAM for Complex Dynamic Environments with Semantic and Geometric Information

OL-SLAM: A Robust and Versatile System of Object Localization and SLAM

DOT-SLAM: A Stereo Visual Simultaneous Localization and Mapping (SLAM) System with Dynamic Object Tracking Based on Graph Optimization

PL-SLAM: A Stereo SLAM System Through the Combination of Points and Line Segments

A Novel And Effective Moving-Objects Detection Method Combined With Stereo Localization And Mapping System

StereoNeuroBayesSLAM: A Neurobiologically Inspired Stereo Visual SLAM System Based on Direct Sparse Method