Abstract:The emergence of modern RGB-D sensors had a significant impact in many application fields, including robotics, augmented reality (AR) and 3D scanning. They are low-cost, low-power and low-size alternatives to traditional range sensors such as LiDAR. Moreover, unlike RGB cameras, RGB-D sensors provide the additional depth information that removes the need of frame-by-frame triangulation for 3D scene reconstruction. These merits have made them very popular in mobile robotics and AR, where it is of great interest to estimate ego-motion and 3D scene structure. Such spatial understanding can enable robots to navigate autonomously without collisions and allow users to insert virtual entities consistent with the image stream. In this chapter, we review common formulations of odometry and Simultaneous Localization and Mapping (known by its acronym SLAM) using RGB-D stream input. The two topics are closely related, as the former aims to track the incremental camera motion with respect to a local map of the scene, and the latter to jointly estimate the camera trajectory and the global map with consistency. In both cases, the standard approaches minimize a cost function using nonlinear optimization techniques. This chapter consists of three main parts: In the first part, we introduce the basic concept of odometry and SLAM and motivate the use of RGB-D sensors. We also give mathematical preliminaries relevant to most odometry and SLAM algorithms. In the second part, we detail the three main components of SLAM systems: camera pose tracking, scene mapping and loop closing. For each component, we describe different approaches proposed in the literature. In the final part, we provide a brief discussion on advanced research topics with the references to the state-of-the-art.

Fast visual odometry and mapping from RGB-D data

A Framework for Multi-Session RGBD SLAM in Low Dynamic Workspace Environment.

Robust visual odometry based on front and back cameras

Robust Keyframe-based Dense SLAM with an RGB-D Camera.

Feature Regions Segmentation Based RGB-D Visual Odometry in Dynamic Environment

Robust 3D Reconstruction with an RGB-D Camera

RGBDTAM: A Cost-Effective and Accurate RGB-D Tracking and Mapping System

RGB-D Odometry and SLAM

Robust Depth-Aided RGBD-Inertial Odometry for Indoor Localization

RGBiD-SLAM for Accurate Real-time Localisation and 3D Mapping

RVD-SLAM: A Real-Time Visual SLAM Toward Dynamic Environments Based on Sparsely Semantic Segmentation and Outlier Prior

RGB-D-E: Event Camera Calibration for Fast 6-DOF object Tracking

Spatiotemporal Visual Odometry Using Ground Plane in Dynamic Indoor Environment

Rgb-D Based Cognitive Map Building And Navigation

Robust and Efficient RGB-D SLAM in Dynamic Environments

Robust Tightly-Coupled Visual-Inertial Odometry with Pre-built Maps in High Latency Situations

RGB‐D SLAM with Moving Object Tracking in Dynamic Environments

Robust Real-time RGB-D Visual Odometry in Dynamic Environments via Rigid Motion Model

Enhancing Visual Odometry with Estimated Scene Depth: Leveraging RGB-D Data with Deep Learning

Probabilistic RGB-D odometry based on points, lines and planes under depth uncertainty

RGB-D Inertial Odometry for a Resource-Restricted Robot in Dynamic Environments