Abstract:With the continuous evolution of autonomous driving and unmanned driving systems, traditional limitations such as a limited field-of-view, poor ranging accuracy, and real-time display are becoming inadequate to satisfy the requirements of binocular stereo-perception systems. Firstly, we designed a binocular stereo-imaging-perception system with a wide-field-of-view and infrared- and visible light-dual-band fusion. Secondly we proposed a binocular stereo-perception optical imaging system with a wide field-of-view of 120.3°, which solves the small field-of-view of current binocular stereo-perception systems. Thirdly, For image aberration caused by the wide-field-of-view system design, we propose an ellipsoidal-image-aberration algorithm with a low consumption of memory resources and no loss of field-of-view. This algorithm simultaneously solves visible light and infrared images with an aberration rate of 45% and 47%, respectively. Fourthly, a multi-scale infrared- and visible light-image-fusion algorithm is used, which improves the situational-awareness capabilities of a binocular stereo-sensing system in a scene and enhances image details to improve ranging accuracy. Furthermore, this paper is based on the Taylor model-calibration binocular stereo-sensing system of internal and external parameters for limit correction; the implemented algorithms are integrated into an NVIDIA Jetson TX2 + FPGA hardware framework, enabling near-distance ranging experiments. The fusion-ranging accuracy within 20 m achieved an error of 0.02 m, outperforming both visible light- and infrared-ranging methods. It generates the fusion-ranging-image output with a minimal delay of only 22.31 ms at a frame rate of 50 Hz.

Design and Implementation of Binocular Visual System Based on EVision

Human-Computer Interaction System Based on Binocular Stereo Vision

Non-Contact Vision Inspection System Of Geometric Dimension Based On Labview And Imaq Vision

Binocular Bundle Adjustment Based Localization and Terrain Stitching for Robot

Real-time vision system for a Ping-Pong robot

Advancing the Robotic Vision Revolution: Development and Evaluation of a Bionic Binocular System for Enhanced Robotic Vision

Binocular Stereo Location on Emulator Robot

Research on target tracking of binocular vision robot

Stereo Vision for Visual Object Tracking and Distance Measurement Assessment

Vision System of Mobile Robot Combining Binocular and Depth Cameras

Binocular Stereo Vision Based 3D Mapping for Micro Aerial Vehicles in an Indoor Environment

A Binocular Stereo-Imaging-Perception System with a Wide Field-of-View and Infrared- and Visible Light-Dual-Band Fusion

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Gesture recognition based on binocular vision

Calibration and location analysis of a heterogeneous binocular stereo vision system

A Platform for Computer Vision Development Based on Two Cameras

Research on the Industrial Robot Grasping Method Based on Multisensor Data Fusion and Binocular Vision

Binocular stereovision omnidirectional motion handling robot

Vision System Prototype for Inspection and Monitoring with a Smart Camera

A Vision-Based Fully-Automatic Calibration Method for Hand-Eye Serial Robot

Improved Calibration of Eye-in-Hand Robotic Vision System Based on Binocular Sensor