Abstract:Most visual simultaneous localization and mapping (SLAM) systems are based on the assumption of a static environment in autonomous vehicles. However, when dynamic objects, particularly vehicles, occupy a large portion of the image, the localization accuracy of the system decreases significantly. To mitigate this challenge, this paper unveils DOT-SLAM, a novel stereo visual SLAM system that integrates dynamic object tracking through graph optimization. By integrating dynamic object pose estimation into the SLAM system, the system can effectively utilize both foreground and background points for ego vehicle localization and obtain a static feature points map. To rectify the inaccuracies in depth estimation from stereo disparity directly on the foreground points of dynamic objects due to their self-similarity characteristics, a coarse-to-fine depth estimation method based on camera–road plane geometry is presented. This method uses rough depth to guide fine stereo matching, thereby obtaining the 3 dimensions (3D)spatial positions of feature points on dynamic objects. Subsequently, by establishing constraints on the dynamic object's pose using the road plane and non-holonomic constraints (NHCs) of the vehicle, reducing the initial pose uncertainty of dynamic objects leads to more accurate dynamic object initialization. Finally, by considering foreground points, background points, the local road plane, the ego vehicle pose, and dynamic object poses as optimization nodes, through the establishment and joint optimization of a nonlinear model based on graph optimization, accurate six degrees of freedom (DoFs) pose estimations are obtained for both the ego vehicle and dynamic objects. Experimental validation on the KITTI-360 dataset demonstrates that DOT-SLAM effectively utilizes features from the background and dynamic objects in the environment, resulting in more accurate vehicle trajectory estimation and a static environment map. Results obtained from a real-world dataset test reinforce the effectiveness.

Visual SLAM with Multi-Object Tracking Using Hybrid Features

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

A robust stereo feature-aided semi-direct SLAM system

A Visual-Inertial Dynamic Object Tracking SLAM tightly coupled system

A Robust Multi-Object Tracking SLAM System in Dynamic Scenes for Stereo and RGB-D Cameras

RGB‐D SLAM with Moving Object Tracking in Dynamic Environments

A Stereo Vision SLAM with Moving Vehicles Tracking in Outdoor Environment

Visual-Inertial Multi-Instance Dynamic SLAM with Object-level Relocalisation

Fast, Robust, Accurate, Multi-Body Motion Aware SLAM

OTE-SLAM: An Object Tracking Enhanced Visual SLAM System for Dynamic Environments

DM-SLAM: A Feature-Based SLAM System for Rigid Dynamic Scenes

Visual SLAM in Dynamic Environments Based on Object Detection and Scene Flow

DyStSLAM: An Efficient Stereo Vision SLAM System in Dynamic Environment

DMOT-SLAM: Visual SLAM in Dynamic Environments with Moving Object Tracking

DOT-SLAM: A Stereo Visual Simultaneous Localization and Mapping (SLAM) System with Dynamic Object Tracking Based on Graph Optimization

Robust Perception-based Visual Simultaneous Localization and Tracking in Dynamic Environments

Visual Inertial SLAM Based on Spatiotemporal Consistency Optimization in Diverse Environments

Visual SLAM in dynamic environments based on object detection

Monocular Visual-Inertial Navigation for Dynamic Environment

Dynamic SLAM System Based on Object Detection