Abstract:Neural network-based stereo matching algorithmms have made significant progress in fields such as robot navigation and autonomous driving. These application scenarios where fast and accurate obtaining the disparity of stereo images is critical for real-time stereo matching decisions. However, current stereo matching algorithms face the challenge of balancing real-time and accuracy while maintaining high accuracy. In this paper, we propose a disparity update strategy based on geometric encoding (MDStereo), which uses global and non-local geometric feature information to update disparity for highly accurate and quick matching. The proposed MDStereo constructs a group of geometric encoding volumes to encode the local information of the image; Next, a new GEDU method for disparity updating is proposed, which retrieves the correlation of high-resolution cost volumes in the form of sampling, and then fuses the geometric encoding information to iteratively update the disparity. Compared to RAFT-Stereo which retrieves correlations from all cascade cost volumes, our GEDU not only provides rich information but also has a more concise architecture. Furthermore, to speed up the inference of the algorithm, we improve the 3D stacked hourglass network, which effectively increases the receptive field and reduces the computational complexity. Our MDStereo has validated its effectiveness and accuracy on several benchmarks, achieving an EPE (end point error) of 0.58 pixels, a 3-pixel error of 2.58%, and a runtime of 43ms on the Scene Flow dataset. At the time of writing, MDStereo outperformed the published real-time methods at the popular KITTI 2012 and KITTI 2015. Compared with existing iteratively updating disparity methods (e.g., RAFT-Stereo), our method reduces the memory consumption by 54% and greatly improves the inference speed.

Improved Algorithm for Estimating Disparity Using Non-Uniform Mesh

Space-temporal stereo matching for dynamic scene

An Efficient Stereo Disparity Estimation Method Based on Region Information

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Adaptive Disparity Computation Using Local and Non-Local Cost Aggregations

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

A Stereo Video Object Segmentation Algorithm Based on Motion Detection and Disparity

Stereo Matching Method with Integrated Geometric Encoding for Disparity Refinement

New Real-Time Algorithm for Multiview Disparity-Based 3D-Object Segmentation.

A Temporally Streamlined Optimization Method for Stereo Video Correspondence

Stereo matching algorithm using improved guided filtering

A multiview video quality assessment method based on disparity and SSIM

Mutual information based non-parametric transform stereo matching algorithm

Fast disparity estimation using spatio-temporal correlation of disparity field for multiview video coding

Disparity Estimation and Virtual View Synthesis from Stereo Video

Stereo Matching with Improved Radiometric Invariant Matching Cost and Disparity Refinement

Disparity Computation With Low Intensity Quantization on Stereo Image Pairs

Fast multi-view disparity estimation for multi-view video systems

An Efficient Adaptive Window Based Disparity Map Computation Algorithm by Dense Two Frame Stereo Correspondence

Dynamic programming with adaptive and self-adjusting penalty for real-time accurate stereo matching

A Novel Cell Structure‐based Disparity Estimation for Unsupervised Stereo Matching