Abstract:Neural network-based stereo matching algorithmms have made significant progress in fields such as robot navigation and autonomous driving. These application scenarios where fast and accurate obtaining the disparity of stereo images is critical for real-time stereo matching decisions. However, current stereo matching algorithms face the challenge of balancing real-time and accuracy while maintaining high accuracy. In this paper, we propose a disparity update strategy based on geometric encoding (MDStereo), which uses global and non-local geometric feature information to update disparity for highly accurate and quick matching. The proposed MDStereo constructs a group of geometric encoding volumes to encode the local information of the image; Next, a new GEDU method for disparity updating is proposed, which retrieves the correlation of high-resolution cost volumes in the form of sampling, and then fuses the geometric encoding information to iteratively update the disparity. Compared to RAFT-Stereo which retrieves correlations from all cascade cost volumes, our GEDU not only provides rich information but also has a more concise architecture. Furthermore, to speed up the inference of the algorithm, we improve the 3D stacked hourglass network, which effectively increases the receptive field and reduces the computational complexity. Our MDStereo has validated its effectiveness and accuracy on several benchmarks, achieving an EPE (end point error) of 0.58 pixels, a 3-pixel error of 2.58%, and a runtime of 43ms on the Scene Flow dataset. At the time of writing, MDStereo outperformed the published real-time methods at the popular KITTI 2012 and KITTI 2015. Compared with existing iteratively updating disparity methods (e.g., RAFT-Stereo), our method reduces the memory consumption by 54% and greatly improves the inference speed.

A new combination of monocular and stereo cues for dense disparity estimation

Space-temporal stereo matching for dynamic scene

Disparity Estimation Based on the Combination of Depth Camera and Stereo Vision

An Efficient Stereo Disparity Estimation Method Based on Region Information

PQMPV: Parallel and Quantified Dense Stereo Disparity Estimation Based on Multi-Path Viterbi

Adaptive Disparity Computation Using Local and Non-Local Cost Aggregations

Extracting Disparity Map from Bifocal Monocular Stereo Vision in a Novel Way

Dense disparity estimation based on the Bi-dimensional Empirical Mode Decomposition and Riesz transformation

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

Stereo-Based Dense Disparity Estimation for Lunar Surface

Coordinating Multiple Disparity Proposals for Stereo Computation.

A depth map estimation approach for trinocular stereo

Stereo Matching Method with Integrated Geometric Encoding for Disparity Refinement

Disparity Map Enhancement Based Stereo Matching Method Using Optical Flow

A volumetric iterative approach to stereo matching and occlusion detection

Graph-based Stereo Matching by Incorporating Monocular Cues

Disparity Estimation with Scene Depth Cues

Dense Stereo Correspondence with Contrast Context Histogram, Segmentation-Based Two-Pass Aggregation and Occlusion Handling

A novel stereo matching pipeline with robustness and unfixed disparity search range

Image-Based End-to-End Neural Network for Dense Disparity Estimation

Accurate Disparity Estimation Based on Integrated Cost Initialization