Abstract:With the continuous evolution of autonomous driving and unmanned driving systems, traditional limitations such as a limited field-of-view, poor ranging accuracy, and real-time display are becoming inadequate to satisfy the requirements of binocular stereo-perception systems. Firstly, we designed a binocular stereo-imaging-perception system with a wide-field-of-view and infrared- and visible light-dual-band fusion. Secondly we proposed a binocular stereo-perception optical imaging system with a wide field-of-view of 120.3°, which solves the small field-of-view of current binocular stereo-perception systems. Thirdly, For image aberration caused by the wide-field-of-view system design, we propose an ellipsoidal-image-aberration algorithm with a low consumption of memory resources and no loss of field-of-view. This algorithm simultaneously solves visible light and infrared images with an aberration rate of 45% and 47%, respectively. Fourthly, a multi-scale infrared- and visible light-image-fusion algorithm is used, which improves the situational-awareness capabilities of a binocular stereo-sensing system in a scene and enhances image details to improve ranging accuracy. Furthermore, this paper is based on the Taylor model-calibration binocular stereo-sensing system of internal and external parameters for limit correction; the implemented algorithms are integrated into an NVIDIA Jetson TX2 + FPGA hardware framework, enabling near-distance ranging experiments. The fusion-ranging accuracy within 20 m achieved an error of 0.02 m, outperforming both visible light- and infrared-ranging methods. It generates the fusion-ranging-image output with a minimal delay of only 22.31 ms at a frame rate of 50 Hz.

Humanoid monocular stereo measuring system with two degrees of freedom using bionic optical imaging system

Human-Computer Interaction System Based on Binocular Stereo Vision

Research progress of depth detection in vision measurement: A novel project of bifocal imaging system for 3D measurement

Optical-probe-imaging-based stereo cameras 3D coordinate measuring system

Panoramic Stereo Imaging of a Bionic Compound-Eye Based on Binocular Vision

3D reconstruction from bifocus imaging

Three-Dimensional Measurement System Based on Micro Stereovision

Development of neural‐network‐based stereo bionic compound eyes with fiber bundles

3D Perception of Biomimetic Eye Based on Motion Vision and Stereo Vision

Research on Monocular Depth Sensing Method Based on Liquid Zoom Imaging

Monocular Multi-View Stereo Imaging System

A new 3D high accuracy optical coordinates measuring technique based on an infrared target and binocular stereo vision

Real-Time Distance Measurement and Tracking Based Binocular Robot

A Binocular Stereo-Imaging-Perception System with a Wide Field-of-View and Infrared- and Visible Light-Dual-Band Fusion

A Monocular Stereo Vision Algorithm Based on Bifocal Imaging

A Novel Measurement System Based on Binocular Fisheye Vision and its Application in Dynamic Environment

Light Probe Based Large FOV 3D Vision Measurement System

Measurement of Mandibular Motion Trajectory Based on Binocular Stereo Vision

Omnidirectional Stereo Vision Sensor Based on Single Camera and Catoptric System.

Modeling of Binocular Stereo Vision for Remote Coordinate Measurement and Fast Calibration

Monocular Multi-Viewpoints Stereo Imaging and Application