Abstract:Visual sensor-based human–computer interaction can provide environmental perception data of traffic road scenes for mechatronic intelligent vehicles. The existing three-dimensional (3D) reconstruction visualization schemes are mainly based on structured scene reconstruction with multiview geometry and are offline operations. It is difficult for large-scale autonomous driving scenes with wide baselines to ensure consistent reconstruction results in the wide field-of-view area and the center of the light-of-sight area. It is also difficult to achieve uniform reconstruction results for regions with drastic depth changes and inconsistent texture fineness. Therefore, we propose a 3D reconstruction-based visualization pipeline for autonomous driving scenes of wide baseline. First, the stereo geometric model is initialized. The parameters of distortion correction and polar calibration are calibrated. Second, the proposed feature chain code resampling (FCCR) is used to uniformly extract the features for regions with inconsistent texture fineness and depth variation. The filtered 3D data are obtained based on the stereo geometric model. Finally, the texture mapping of the mesh skeleton of 3D data is carried out by the bilinear combination of surrounding multilevel gradual textures. The visualization results of scene rendering and scene roaming are realized. The pipeline has been effectively verified on the simulated experimental platform, real vehicle test, and public dataset. It can meet the real-time 3D reconstruction visualization of wide-baseline scenes. The reconstruction texture is uniform, and the detail response is rich. We can present the intuitive, 3D, real-time, graphical physical quantities of scene data for drivers, intelligent vehicles, AR-HUD, and control systems. The method we present has research value and application significance for the practical engineering of electronic images.

Outdoor 3D Environment Reconstruction based on Multi-sensor Fusion for Remote Control

3-D Map Reconstruction in Cross-country Environment

3-D Surround View for Advanced Driver Assistance Systems.

A Fusion Method Aiming at Environmental Perception of Autonomous Vehicle Based on Visual Scheme

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

3D Reconstruction Approach for Outdoor Scene Based on Multiple Point Cloud Fusion

Environmental Detection for Autonomous Vehicles Based on Multi-View Image and 3D LiDAR Point Cloud Map

Three-Dimensional Geometric-Physical Modeling of an Environment with an In-House-Developed Multi-Sensor Robotic System

P‐2.11: Research on Scene 3d Reconstruction Technology Based on Multi‐sensor Fusion

Visual Odometry Based 3D-Reconstruction

Visualization pipeline of autonomous driving scenes based on FCCR-3D reconstruction

Real-Time Generation and Automatic Update of 3D Point Cloud Maps in Featureless Environments Based on Multi-Sensor Fusion

Design Of 3d Reconstruction System On Quadrotor Fusing Lidar And Camera

3D Environmental Perception Modeling in the Simulated Autonomous-Driving Systems

Depth Camera Based Remote Three-Dimensional Reconstruction Using Incremental Point Cloud Compression.

Review of Three-Dimensional Environment Information Perception and Reconstruction Methods for Mobile Robot Based on Multi-Sensor Fusion

Research on Surface Environment Perception Via Camera-LiDAR Sensor Fusion

Research on Off-road Environment Perception Based on Multi-sensor Fusion

A Robust Real-Time Computing-based Environment Sensing System for Intelligent Vehicle

A Dynamic Object Removing 3D Reconstruction System Based on Multi-Sensor Fusion

A Compact Handheld Sensor Package with Sensor Fusion for Comprehensive and Robust 3D Mapping