Abstract:Visual-LiDAR odometry and mapping (V-LOAM), which fuses complementary information of a camera and a LiDAR, is an attractive solution for accurate and robust pose estimation and mapping. However, existing systems could suffer nontrivial tracking errors arising from 1) association between 3D LiDAR points and sparse 2D features (i.e., 3D-2D depth association) and 2) obvious drifts in the vertical direction in the 6-degree of freedom (DOF) sweep-to-map optimization. In this paper, we present SDV-LOAM which incorporates a semi-direct visual odometry and an adaptive sweep-to-map LiDAR odometry to effectively avoid the above-mentioned errors and in turn achieve high tracking accuracy. The visual module of our SDV-LOAM directly extracts high-gradient pixels where 3D LiDAR points project on for tracking. To avoid the problem of large scale difference between matching frames in the VO, we design a novel point matching with propagation method to propagate points of a host frame to an intermediate keyframe which is closer to the current frame to reduce scale differences. To reduce the pose estimation drifts in the vertical direction, our LiDAR module employs an adaptive sweep-to-map optimization method which automatically choose to optimize 3 horizontal DOF or 6 full DOF pose according to the richness of geometric constraints in the vertical direction. In addition, we propose a novel sweep reconstruction method which can increase the input frequency of LiDAR point clouds to the same frequency as the camera images, and in turn yield a high frequency output of the LiDAR odometry in theory. Experimental results demonstrate that our SDV-LOAM ranks 8th on the KITTI odometry benchmark which outperforms most LiDAR/visual-LiDAR odometry systems. In addition, our visual module outperforms state-of-the-art visual odometry and our adaptive sweep-to-map optimization can improve the performance of several existing open-sourced LiDAR odometry systems. Moreover, we demonstrate our SDV-LOAM on a custom-built hardware platform in large-scale environments which achieves both a high accuracy and output frequency. We have released the source code of our SDV-LOAM for the development of the community.

SR-LIVO: LiDAR-Inertial-Visual Odometry and Mapping With Sweep Reconstruction

SR-LIO: LiDAR-Inertial Odometry with Sweep Reconstruction

Ct-LVI: A Framework Toward Continuous-Time Laser-Visual-Inertial Odometry and Mapping

SDV-LOAM: Semi-Direct Visual-LiDAR Odometry and Mapping

FAST-LIVO: Fast and Tightly-coupled Sparse-Direct LiDAR-Inertial-Visual Odometry

FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry

LVIO-SAM: A Multi-sensor Fusion Odometry via Smoothing and Mapping

R$^3$LIVE++: A Robust, Real-time, Radiance reconstruction package with a tightly-coupled LiDAR-Inertial-Visual state Estimator

LIEO-SAM-Iris: Tightly-coupled Lidar Inertial Encoder Odometry via Smoothing and Mapping based on Iris loop closure.

RLP‐VIO: Robust and Lightweight Plane‐based Visual‐inertial Odometry for Augmented Reality

R 3LIVE++: A Robust, Real-Time, Radiance Reconstruction Package With a Tightly-Coupled LiDAR-Inertial-Visual State Estimator

R3LIVE: A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping package

OR-LIM: Observability-aware Robust LiDAR-inertial-mapping under High Dynamic Sensor Motion

LiVisSfM: Accurate and Robust Structure-from-Motion with LiDAR and Visual Cues

Ct-LVI: A Framework Towards Continuous-time Laser-Visual-Inertial Odometry and Mapping

LVIO-Fusion:Tightly-Coupled LiDAR-Visual-Inertial Odometry and Mapping in Degenerate Environments

Point-Line LIVO Using Patch-Based Gradient Optimization for Degenerate Scenes

R-LIOM: Reflectivity-Aware LiDAR-Inertial Odometry and Mapping.

RI-LIO: Reflectivity Image Assisted Tightly-Coupled LiDAR-Inertial Odometry

RB-LIO: A SLAM Solution Applied to Large-Scale Dynamic Scenes with Multiple Moving Objects

FR-LIO: Fast and Robust Lidar-Inertial Odometry by Tightly-Coupled Iterated Kalman Smoother and Robocentric Voxels