Abstract:Exploiting multi-level context information to cost volume can improve the performance of learning-based stereo matching methods. In recent years, 3-D Convolution Neural Networks (3-D CNNs) show the advantages in regularizing cost volume but are limited by unary features learning in matching cost computation. However, existing methods only use features from plain convolution layers or a simple aggregation of multi-level features to calculate cost volume, which is insufficient because stereo matching requires discriminative features to identify corresponding pixels in rectified stereo image pairs. In this paper, we propose a unary features descriptor using multi-level context ultra-aggregation (MCUA), which encapsulates all convolutional features into a more discriminative representation by intra- and inter-level features combination. Specifically, a child module that takes low-resolution images as input captures larger context information; the larger context information from each layer is densely connected to the main branch of the network. MCUA makes good usage of multi-level features with richer context and performs the image-to-image prediction holistically. We introduce our MCUA scheme for cost volume calculation and test it on PSM-Net. We also evaluate our method on Scene Flow and KITTI 2012/2015 stereo datasets. Experimental results show that our method outperforms state-of-the-art methods by a notable margin and effectively improves the accuracy of stereo matching.

Cost Volume Aggregation in Stereo Matching Revisited: A Disparity Classification Perspective

Asymmetric Cost Aggregation Network for Efficient Stereo Matching

Initial Left Image R ight Image Hand-Designed Cost Aggregation Disparity Map Disparity Computation A ggregated C ost Volume Extracting Guidance Aggregation Guidance Generaing Aggregation Proposals Aggregation Proposals Fusion Aggregated Cost Volume Disparity Map Disparity Computation A : The Typical

HIERARCHICAL CONTEXT GUIDED AGGREGATION NETWORK FOR STEREO MATCHING

CVCNet: Learning Cost Volume Compression for Efficient Stereo Matching

Multi-Level Context Ultra-Aggregation for Stereo Matching

Inter-Scale Similarity Guided Cost Aggregation for Stereo Matching

A revisit to cost aggregation in stereo matching: How far can we reduce its computational redundancy?

Deep Stereo Network with MRF-Based Cost Aggregation

Content-Aware Inter-Scale Cost Aggregation for Stereo Matching

Adaptive Disparity Computation Using Local and Non-Local Cost Aggregations

Deep Stereo Matching with Explicit Cost Aggregation Sub-Architecture

Stereo Matching with Cost Volume based Sparse Disparity Propagation

Stereo Matching with Space-Constrained Cost Aggregation and Segmentation-Based Disparity Refinement

Hybrid cost aggregation for dense stereo matching

Guided aggregation and disparity refinement for real-time stereo matching

Deep Stereo Matching with Superpixel Based Feature and Cost.

Hierarchical and Multi-Level Cost Aggregation for Stereo Matching.

SPNet: Learning Stereo Matching With Slanted Plane Aggregation

CombineNet: A Stereo Network Combining Local and Semi-global Aggregation

Edge-preserving Guided Filtering Based Cost Aggregation for Stereo Matching.