Abstract:Deep learning based on convolutional neural network (CNN) has been successfully applied to stereo matching, which has achieved greater improvement in speed and accuracy compared with traditional methods. However, existing CNN-based stereo matching frameworks frequently encounter two problems. First, the existing stereo matching network has a large number of parameters, which results in too long matching running time since excessive network width and excessive number of convolution kernels. Second, in some areas where reflection, refraction and fine structure may lead to ill-posed problems, the disparity estimation errors can be occurred. In this paper, we proposed a lightweight network, convolution attention residual network (CAR-Net), which can balance the real-time matching and matching accuracy for stereo matching. Besides, a multi-scale residual network called CBAM-ResNeXt, which combines attention, was proposed for features extraction. With an aim is to simplify the parameters of the network model by reducing the size of filters and to extract the semantic features such as categories and locations from the image through convolutional block attention module (CBAM). Here, the CBAM consists of channel attention module and spatial attention module, where the semantic information of the feature map can be fully maintained after the parameters were simplified. Moreover, we proposed a dimension-extended 3D-CBAM, which is connected to 3DCNN for cost aggregation. By combining these two sub-modules of attention, the network is guided to selectively focus on the foreground or background regions, so as to improve the disparity accuracy in the ill-posed regions. The experimental results showed that our proposed method generated high accuracy and optimized the velocity compared to the state-of-the-art benchmark on KITTI 2012, KITTI 2015 and Scene Flow.

A Transformer-Based Architecture for High-Resolution Stereo Matching

End-to-end information fusion method for transformer-based stereo matching

Efficient Stereo Matching Using Swin Transformer and Multilevel Feature Consistency in Autonomous Mobile Systems

Deep Laparoscopic Stereo Matching with Transformers

MA-Stereo: Real-Time Stereo Matching Via Multi-Scale Attention Fusion and Spatial Error-Aware Refinement

Playing to Vision Foundation Model's Strengths in Stereo Matching

Multi-level Pyramid Fusion for Efficient Stereo Matching

Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformers

Steformer: Efficient Stereo Image Super-Resolution with Transformer

Transformer-based stereo-aware 3D object detection from binocular images

Multi-scale Alternated Attention Transformer for Generalized Stereo Matching

Coatrsnet: Fully Exploiting Convolution and Attention for Stereo Matching by Region Separation

Multi-scale Cross-form Pyramid Network for Stereo Matching

Transformer-guided Feature Pyramid Network for Multi-View Stereo

Unifying Flow, Stereo and Depth Estimation.

Exploiting Semantic and Boundary Information for Stereo Matching

A Convolutional Attention Residual Network for Stereo Matching

Feature‐enhanced representation with transformers for multi‐view stereo

ChiTransformer:Towards Reliable Stereo from Cues

Sliding Space-Disparity Transformer for Stereo Matching.

Cascaded Feature Interaction Network for Stereo Matching