Semantic Object and Plane SLAM for RGB-D Cameras.

Longyu Zheng,Wenbing Tao
DOI: https://doi.org/10.1007/978-3-030-31726-3_12
2019-01-01
Abstract:Simultaneous Localization And Mapping (SLAM) is a fundamental problem in mobile robotics as well as in virtual reality (VR) and augmented reality (AR). Traditional visual-SLAM systems, such as ORB-SLAM, deal with sparse features extracted from high gradient image regions. While being robust and stable to light changing, camera rotation and scale changing to some extent, they are easy to accumulate drifts and cannot provide high-level information of the environment. To solve this problem, we take advantage of state of the art object detectors and a robust ICP method to build a map made up of objects providing semantic information as well as extra constraints to original point-based SLAM system. What’s more, for indoor scenes where planar structures are common, we introduce plane landmarks into SLAM framework to reduce drift. Experiments show that the our method can build a semantically more meaningful map without reducing the original SLAM system’s performance remarkably.
What problem does this paper attempt to address?