Abstract:Neural network-based stereo matching algorithmms have made significant progress in fields such as robot navigation and autonomous driving. These application scenarios where fast and accurate obtaining the disparity of stereo images is critical for real-time stereo matching decisions. However, current stereo matching algorithms face the challenge of balancing real-time and accuracy while maintaining high accuracy. In this paper, we propose a disparity update strategy based on geometric encoding (MDStereo), which uses global and non-local geometric feature information to update disparity for highly accurate and quick matching. The proposed MDStereo constructs a group of geometric encoding volumes to encode the local information of the image; Next, a new GEDU method for disparity updating is proposed, which retrieves the correlation of high-resolution cost volumes in the form of sampling, and then fuses the geometric encoding information to iteratively update the disparity. Compared to RAFT-Stereo which retrieves correlations from all cascade cost volumes, our GEDU not only provides rich information but also has a more concise architecture. Furthermore, to speed up the inference of the algorithm, we improve the 3D stacked hourglass network, which effectively increases the receptive field and reduces the computational complexity. Our MDStereo has validated its effectiveness and accuracy on several benchmarks, achieving an EPE (end point error) of 0.58 pixels, a 3-pixel error of 2.58%, and a runtime of 43ms on the Scene Flow dataset. At the time of writing, MDStereo outperformed the published real-time methods at the popular KITTI 2012 and KITTI 2015. Compared with existing iteratively updating disparity methods (e.g., RAFT-Stereo), our method reduces the memory consumption by 54% and greatly improves the inference speed.

Research on stereo Matching algorithm based on neural network

Efficient Large Scale Stereo Matching Based on Cross-Scale.

Parallax attention stereo matching network based on the improved group-wise correlation stereo network

Disparity Estimation Using Multilevel and Global Information

Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation

Exploiting Semantic and Boundary Information for Stereo Matching

A Joint 2D-3D Complementary Network for Stereo Matching

Stereo Matching Method for Remote Sensing Images Based on Attention and Scale Fusion

Deep Stereo Matching With Hysteresis Attention and Supervised Cost Volume Construction

Stacking Learning with Coalesced Cost Filtering for Accurate Stereo Matching

Learning Local Event-based Descriptor for Patch-based Stereo Matching

Stereo Matching Using Multi-Level Cost Volume and Multi-Scale Feature Constancy

An efficient and accurate multi-level cascaded recurrent network for stereo matching

A Fast Stereo Matching Network with Multi-Cross Attention

Stereo Matching Method with Integrated Geometric Encoding for Disparity Refinement

Multi-Scale Cost Volumes Cascade Network for Stereo Matching

Local Similarity Pattern and Cost Self-Reassembling for Deep Stereo Matching Networks

Multi-Dimensional Cooperative Network for Stereo Matching

Ghost-Stereo: GhostNet-based Cost Volume Enhancement and Aggregation for Stereo Matching Networks

An end-to-end stereo matching algorithm based on improved convolutional neural network

MULTI-SCALE CASCADE DISPARITY REFINEMENT STEREO NETWORK