Abstract:Deep learning based on convolutional neural network (CNN) has been successfully applied to stereo matching, which has achieved greater improvement in speed and accuracy compared with traditional methods. However, existing CNN-based stereo matching frameworks frequently encounter two problems. First, the existing stereo matching network has a large number of parameters, which results in too long matching running time since excessive network width and excessive number of convolution kernels. Second, in some areas where reflection, refraction and fine structure may lead to ill-posed problems, the disparity estimation errors can be occurred. In this paper, we proposed a lightweight network, convolution attention residual network (CAR-Net), which can balance the real-time matching and matching accuracy for stereo matching. Besides, a multi-scale residual network called CBAM-ResNeXt, which combines attention, was proposed for features extraction. With an aim is to simplify the parameters of the network model by reducing the size of filters and to extract the semantic features such as categories and locations from the image through convolutional block attention module (CBAM). Here, the CBAM consists of channel attention module and spatial attention module, where the semantic information of the feature map can be fully maintained after the parameters were simplified. Moreover, we proposed a dimension-extended 3D-CBAM, which is connected to 3DCNN for cost aggregation. By combining these two sub-modules of attention, the network is guided to selectively focus on the foreground or background regions, so as to improve the disparity accuracy in the ill-posed regions. The experimental results showed that our proposed method generated high accuracy and optimized the velocity compared to the state-of-the-art benchmark on KITTI 2012, KITTI 2015 and Scene Flow.

A Multimodal-Based Feature Generalization Model for Binocular Stereo Matching

Global Matching-Optimization Network for Stereo Depth Estimation

Multi-Dimensional Cooperative Network for Stereo Matching

Stereo Matching Using Multi-Level Cost Volume and Multi-Scale Feature Constancy

Matching-space Stereo Networks for Cross-domain Generalization

Robust Stereo Matching Using Discriminative Multilevel Features and Multimodal Bifurcated Cost Volume Network

Stereo matching from monocular images using feature consistency

Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspective

GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Feature

Multi-Scale Binocular Stereo Matching Based on Semantic Association

Stereo sample generation‐based domain generalization network for stereo matching

Masked Representation Learning for Domain Generalized Stereo Matching

A Fast Stereo Matching Network with Multi-Cross Attention

Accuracy and efficiency stereo matching network with adaptive feature modulation

Cascaded Feature Interaction Network for Stereo Matching

A Convolutional Attention Residual Network for Stereo Matching

Zoom and Learn: Generalizing Deep Stereo Matching to Novel Domains

Stereo Matching by Self-supervision of Multiscopic Vision.

Superpixel Guided Network for Three-Dimensional Stereo Matching

Unsupervised Cross-Spectral Stereo Matching by Learning to Synthesize.

Supervised Biadjacency Networks for Stereo Matching