Abstract:A self‐supervised training framework for stereo matching network based on image reconstruction loss combined with a generative‐adversarial strategy is explored. For imperfect stereo rectification of binocular images, a novel calibration‐free real‐time self‐rectification network and a vertical offset prediction module (VOPM) for this self‐supervised framework is designed. Aiming to address the challenge where existing methods struggle to predict accurate disparities for imperfectly rectified stereo images, and that supervised training requires a considerable amount of ground truth, a self‐supervised binocular depth estimation algorithm with self‐rectification for autonomous driving is proposed. Firstly, a subnetwork dedicated to stereo rectification, aiming to estimate the homography between stereo images is developed. This homography facilitates the transformation of stereo image pairs, aligning their corresponding pixels horizontally. Secondly, a foundational self‐supervised framework primarily centred on minimizing errors in stereo image reconstruction, combined with the generative‐adversarial strategy is introduced. Finally, a vertical offset prediction module (VOPM) is incorporated into the basic framework to further enhance the resistance of the stereo matching network to pixel‐level vertical offset errors. Experimental results on the public KITTI dataset for autonomous driving demonstrate the effectiveness of this approach in improving the disparity prediction performance for imperfectly rectified stereo images. Moreover, the self‐supervised training framework exhibits superiority over state‐of‐the‐art methods.

A real-time dense stereo matching method for critical environment sensing in autonomous driving

Real-time Dense Disparity Estimation Based on Multi-Path Viterbi for Intelligent Vehicle Applications.

MA-Stereo: Real-Time Stereo Matching Via Multi-Scale Attention Fusion and Spatial Error-Aware Refinement

A Real-time Multi-lane Detection Approach Using Features Geometric Uncertainty and Stereo Vision

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

3D object detection and state estimation method based on stereo vision and LIDAR fusion

A Robust Real-Time Computing-based Environment Sensing System for Intelligent Vehicle

A Stereo Vision Sensor for Environmental Detection of Intelligent Vehicle

Improving RealSense by Fusing Color Stereo Vision and Infrared Stereo Vision for the Visually Impaired

Self‐supervised binocular depth estimation algorithm with self‐rectification for autonomous driving

A Real-Time Traffic Environmental Perception Algorithm Fusing Stereo Vision and Deep Network.

Online Stereovision Calibration Using On-Road Markings

Improved real-time three-dimensional stereo matching with local consistency

Real-Time Dense Stereo Embedded in a UAV for Road Inspection

Accelerated stereo matching for autonomous vehicles using an upright pinhole camera model

Real-time depth completion based on LiDAR-stereo for autonomous driving

Stereo Matching Accelerator With Re-Computation Scheme and Data-Reused Pipeline for Autonomous Vehicles

Real-time obstacle detection by stereo vision and ultrasonic data fusion

Real-Time Stereo 3D Car Detection With Shape-Aware Non-Uniform Sampling

Real-Time Accurate Stereo Matching Using Modified Two-Pass Aggregation and Winner-Take-All Guided Dynamic Programming

Stereo R-CNN based 3D Object Detection for Autonomous Driving