Self‐supervised binocular depth estimation algorithm with self‐rectification for autonomous driving
Jingyao Bao,Hongfei Yu,Yongjia Zou,Jin Lv,Wei Liu,Yang Cao
DOI: https://doi.org/10.1049/itr2.12522
IF: 2.7
2024-06-21
IET Intelligent Transport Systems
Abstract:A self‐supervised training framework for stereo matching network based on image reconstruction loss combined with a generative‐adversarial strategy is explored. For imperfect stereo rectification of binocular images, a novel calibration‐free real‐time self‐rectification network and a vertical offset prediction module (VOPM) for this self‐supervised framework is designed. Aiming to address the challenge where existing methods struggle to predict accurate disparities for imperfectly rectified stereo images, and that supervised training requires a considerable amount of ground truth, a self‐supervised binocular depth estimation algorithm with self‐rectification for autonomous driving is proposed. Firstly, a subnetwork dedicated to stereo rectification, aiming to estimate the homography between stereo images is developed. This homography facilitates the transformation of stereo image pairs, aligning their corresponding pixels horizontally. Secondly, a foundational self‐supervised framework primarily centred on minimizing errors in stereo image reconstruction, combined with the generative‐adversarial strategy is introduced. Finally, a vertical offset prediction module (VOPM) is incorporated into the basic framework to further enhance the resistance of the stereo matching network to pixel‐level vertical offset errors. Experimental results on the public KITTI dataset for autonomous driving demonstrate the effectiveness of this approach in improving the disparity prediction performance for imperfectly rectified stereo images. Moreover, the self‐supervised training framework exhibits superiority over state‐of‐the‐art methods.
engineering, electrical & electronic,transportation science & technology