Abstract:In many robotic applications, creating a map is crucial, and 3D maps provide a method for estimating the positions of other objects or obstacles. Most of the previous research processes 3D point clouds through projection-based or voxel-based models, but both approaches have certain limitations. This paper proposes a hybrid localization and mapping method using stereo vision and LiDAR. Unlike the traditional single-sensor systems, we construct a pose optimization model by matching ground information between LiDAR maps and visual images. We use stereo vision to extract ground information and fuse it with LiDAR tensor voting data to establish coplanarity constraints. Pose optimization is achieved through a graph-based optimization algorithm and a local window optimization method. The proposed method is evaluated using the KITTI dataset and compared against the ORB-SLAM3, F-LOAM, LOAM, and LeGO-LOAM methods. Additionally, we generate 3D point cloud maps for the corresponding sequences and high-definition point cloud maps of the streets in sequence 00. The experimental results demonstrate significant improvements in trajectory accuracy and robustness, enabling the construction of clear, dense 3D maps.

3D Terrain Reconstruction for Patrol Robot Using Point Grey Research Stereo Vision Cameras

Stereo Vision Based SLAM in Outdoor Environments

3-D Map Reconstruction in Cross-country Environment

Stereo Vision Based SLAM Using Rao-Blackwellised Particle Filter

Binocular Bundle Adjustment Based Localization and Terrain Stitching for Robot

3D Map Building for Mobile Robot under Unknown Outdoor Environments

Vision Based Terrain Reconstruction for Planet Rover Using a Special Binocular Bundle Adjustment

Visual Traversability Analysis for Micro Planetary Rover

Obstacle Detection and Map Reconstruction Using Multi-Layer Laser Radar

Binocular Stereo Vision Based 3D Mapping for Micro Aerial Vehicles in an Indoor Environment

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Visual Odometry Based 3D-Reconstruction

Stereo and LiDAR Loosely Coupled SLAM Constrained Ground Detection

Vision-Assisted Localization and Terrain Reconstruction with Quadruped Robots

Long-Range 3D Reconstruction Based on Flexible Configuration Stereo Vision Using Multiple Aerial Robots

Vision System of Mobile Robot Combining Binocular and Depth Cameras

Three-Dimensional Reconstruction Based on Quadrotors with Binocular Vision

Stereovision-based 3D Field Recognition for Automatic Guidance System of Off-Road Vehicle

3D surveillance coverage using maps extracted by a monocular SLAM algorithm

Region of Interest Constrained Negative Obstacle Detection and Tracking With a Stereo Camera

Outdoor 3D Environment Reconstruction based on Multi-sensor Fusion for Remote Control