Abstract:In this paper, we propose a tightly-coupled SLAM system fused with RGB, Depth, IMU and structured plane information. Traditional sparse points based SLAM systems always maintain a mass of map points to model the environment. Huge number of map points bring us a high computational complexity, making it difficult to be deployed on mobile devices. On the other hand, planes are common structures in man-made environment especially in indoor environments. We usually can use a small number of planes to represent a large scene. So the main purpose of this article is to decrease the high complexity of sparse points based SLAM. We build a lightweight back-end map which consists of a few planes and map points to achieve efficient bundle adjustment (BA) with an equal or better accuracy. We use homography constraints to eliminate the parameters of numerous plane points in the optimization and reduce the complexity of BA. We separate the parameters and measurements in homography and point-to-plane constraints and compress the measurements part to further effectively improve the speed of BA. We also integrate the plane information into the whole system to realize robust planar feature extraction, data association, and global consistent planar reconstruction. Finally, we perform an ablation study and compare our method with similar methods in simulation and real environment data. Our system achieves obvious advantages in accuracy and efficiency. Even if the plane parameters are involved in the optimization, we effectively simplify the back-end map by using planar structures. The global bundle adjustment is nearly 2 times faster than the sparse points based SLAM algorithm.

Tightly-Coupled Aided Inertial Navigation with Point and Plane Features

LiDAR-Inertial SLAM with Efficiently Extracted Planes

Intensity/Inertial Integration-Aided Feature Tracking on Event Cameras

Efficient Multi-sensor Aided Inertial Navigation with Online Calibration

Observability Analysis of Aided INS with Heterogeneous Features of Points, Lines and Planes

LIC-Fusion 2.0: LiDAR-Inertial-Camera Odometry with Sliding-Window Plane-Feature Tracking

Tightly Coupled Stereo Vision-Inertial Odometry Based on Point and Line Feature

Fusing GNSS/INS/Vision With A Priori Feature Map for High-Precision and Continuous Navigation

A Parameter Self-Calibration Method for GNSS/INS Deeply Coupled Navigation Systems in Highly Dynamic Environments

An Optimization-Based Tightly-Coupled Integration of PPP, INS and Vision for Precise and Continuous Navigation

VIP-SLAM: An Efficient Tightly-Coupled RGB-D Visual Inertial Planar SLAM

Indoor Integrated Navigation of Micro Aerial Vehicle Based on Radar-Scanner and Inertial Navigation System

Inertial-Aided Metric States and Surface Normal Estimation Using a Monocular Camera.

Inertial-aided State and Slope Estimation Using a Monocular Camera

A Robust and Fast GNSS-Inertial-LiDAR Odometry With INS-Centric Multiple Modalities by IESKF

A Planar Multi-Inertial Navigation Strategy for Autonomous Systems for Signal-Variable Environments

Continuous and Precise Positioning in Urban Environments by Tightly Coupled Integration of GNSS, INS and Vision

Research on tightly coupled visual inertial SLAM based on point and line features

CNN-Augmented Visual-Inertial SLAM with Planar Constraints

LiDAR Scan Matching Aided Inertial Navigation System in GNSS-Denied Environments

Design of visual inertial state estimator for autonomous systems via multi-sensor fusion approach