Abstract:Simultaneous localization and mapping (SLAM) using an RGB-D camera is a key enabling technique for many augmented reality (AR) applications. However, most existing RGB-D SLAM methods could fail in dynamic scenarios due to non-trivial pose estimation errors arising from moving objects. In this study, we present an accurate and robust RGB-D SLAM system for dynamic scenarios which can run real-time on a single dual-core CPU. The core of our system is a robust and efficient dynamic keypoint exclusion method which consists of three steps: 1) grouping spatially and appearance related pixels of a keyframe into regions; 2) identifying dynamic regions by checking motion consistency of keypoints in every region; 3) excluding keypoints in the identified dynamic regions as well as the matching points in the 3D local map. The dynamic keypoint exclusion method can be easily integrated into any keypoint based RGB-D SLAM system for improving the accuracy and robustness in dynamic scenes with trivial time increase (16.6ms per frame). Experimental results on the TUM dataset demonstrates that our method which runs on an Intel i7-4900 CPU is even 2.3X faster than the state-of-the-art method DS-SLAM [1] which runs parallel on a P4000 GPU and a comparable CPU. In addition, our system outperforms the state-of-the-art methods [1]–[4] in terms of smaller absolute trajectory errors (ATE). We also apply our system to a real AR application and live experiments with a hand-held RGB-D camera demonstrate the robustness and generalizability of our method in practical scenarios.11A demo video is provided on https://github.com/cc-qy/Dynamic-RGB-D-SLAM

Parallel Tracking and Mapping for Small AR Workspaces

A Framework for Multi-Session RGBD SLAM in Low Dynamic Workspace Environment.

Stereo Vision Based SLAM in Outdoor Environments

Two-Stage Multi-Camera Constrain Mapping Pipeline for Large-Scale 3D Reconstruction

Multi-Session Slam over Low Dynamic Workspace Using Rgbd Sensor

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

Robust Keyframe-Based Monocular SLAM for Augmented Reality

Robust Monocular SLAM in Dynamic Environments

3d Reconstruction Of Dynamic Scenes With Multiple Handheld Cameras

Object Tracking over Multiple Uncalibrated Cameras Using Visual, Spatial and Temporal Similarities.

DH-PTAM: A Deep Hybrid Stereo Events-Frames Parallel Tracking And Mapping System

Robust and Efficient RGB-D SLAM in Dynamic Environments

Robust Dense Mapping for Large-Scale Dynamic Environments

MonoSLAM: Real-Time Single Camera SLAM

Dynamic Parallel Mapping and Trajectory Planning of Robot Arm in Unknown Environment

Event-Based Line SLAM in Real-Time

Real-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera

Simultaneous Multi-View Camera Pose Estimation and Object Tracking with Square Planar Markers

A Visual SLAM With Tightly-Coupled Integration of Multi-Object Tracking for Production Workshop

Human Motion Tracking by Multiple RGBD Cameras.

High-resolution Ecosystem Mapping in Repetitive Environments Using Dual Camera SLAM