Abstract:Simultaneous localization and mapping (SLAM) is the key technology for achieving autonomous navigation and stable walking for robots. For addressing a dynamic and special environment indoors and outdoors, there are still some limitations in using a single sensor to estimate and locate a robot's position and orientation. To further improve the accuracy of SLAM positioning in real time, in this study, we combine the advantages of the RGB-depth map (RGB-D) and light detection and ranging (LiDAR) and propose a model of a two-stage deep fusion framework named convolutional neural network (CNN)-LiDAR vision inertial measurement unit (CNN-LVI) for real-time pose estimation by a geometric method. Unlike existing methods that use either a two-stage framework or multistage pipelines, the proposed framework fuses image and raw 3D point cloud data after multisensor joint calibration, and then uses 3D point clouds as spatial anchors to predict the pose between two sequence frames. By using a CNN algorithm to identify and extract a 3D bounding box, the target object projection of an RGB image is tracked to obtain the target minimum bounding rectangle (MBR). Finally, the rotation angle and translation distance are calculated by a geometric method using the centroid of the target MBR, so as to combine an inertial measurement unit to perform joint optimization, achieve the pose estimation of a robot, and further improve the model's location accuracy. Experiments show that the proposed model achieves significant performance improvement compared with many other methods in the car class and achieves the best trade-off between state-of-the-art performance and accuracy on the benchmark with the KITTI dataset.

Real-time Wide-depth-range Pose Estimation with Laser Scanning Point Cloud

Pose Estimation and Neural Implicit Reconstruction Towards Non-Cooperative Spacecraft Without Offline Prior Information

3D Point-to-Keypoint Voting Network for 6D Pose Estimation

PA-Pose: Partial Point Cloud Fusion Based on Reliable Alignment for 6D Pose Tracking

Accurate Pose Tracking for Uncooperative Targets via Data Fusion of Laser Scanner and Optical Camera

A Spaceborne Camera Pose Estimate Method Based on High-Precision Point Cloud Model

Pose Estimation for Cross-Domain Non-Cooperative Spacecraft Based on Spatial-Aware Keypoints Regression

Point Cloud Based Relative Pose Estimation of a Satellite in Close Range

Lidar-Based Non-Cooperative Tumbling Spacecraft Pose Tracking By Fusing Depth Maps And Point Clouds

Pose Estimation for Non-cooperative Spacecraft Based on Deep Learning

Sparse Unorganized Point Cloud Based Relative Pose Estimation For Uncooperative Space Target

High Precision Pose Estimation for Uncooperative Targets Based on Monocular Vision and 1D Laser Fusion

Towards Pose Estimation for Large UAV in Close Range

Deep Learning Based Pose Estimation Method Using 3D Point Clouds

Space Target Pose Estimation Based on High-Level Geometric Correspondences for Single-Photon LiDAR

A Posture Estimation Method Based on Viewpoint Feature Histogram for Laser Point Cloud Model

High Precision and Pose Estimation Based on Improved Point Cloud Algorithm for Noncooperative Targets

A Model of Real-time Pose Estimation Fusing Camera and LiDAR in Simultaneous Localization and Mapping by a Geometric Method

Prior-information-guided corresponding point regression network for 6D pose estimation

Non-cooperative Spacecraft Pose Tracking Based on Point Cloud Feature

A large depth-of-field virtual measurement network for non-cooperative 6DOF pose estimation in occlusion scenes