Abstract:The rapid estimation of the accurate disparity between pixels is the goal of stereo matching. However, it is very difficult for the 3D labels-based methods due to huge search space of 3D labels, especially for high-resolution images. In this paper, a novel superpixel cut-based method is proposed, in an attempt to get the accurate disparity map efficiently, including the multi-layer superpixel optimization and iteractive local alpha-expansion in parallel. As for the multi-layer superpixel optimization, feature point optimization is designed to get accurate candidate labels that are set for most pixels using non-local cost aggregation strategy and update per-pixel labels of the corresponding superpixels from the candidate label sets on the small-size superpixel layer, and then update the middle to large-size superpixel layers progressively using non-local cost aggregation strategy. In order to provide more prior information to identify weak texture and textureless regions in non-local cost aggregation, the weight combination of "intensity + gradient + binary image" is proposed for constructing an optimal minimum spanning tree (MST) to calculate the aggregated matching cost and obtain the labels of minimum aggregated matching cost. Moreover, the local patch surrounding the corresponding superpixels is designed to accelerate superpixel optimization in parallel, and a neighborhood structure is presented to optimize the algorithm in this study, including superpixel neighborhood and patch neighborhood. As for the iteractive local alpha-expansion, three layers of patch structure corresponding to the superpixel neighborhood structure is proposed for optimizing the algorithm in this study. The experimental results show that higher accuracy could be achieved via the method in this study compared with some known state-of-the-art stereo methods on KITTI 2015 and Middlebury benchmark V3, which are the standard benchmarks for testing the stereo matching methods.

A Configurable Local-Expansion-Move Accelerator for Accurate Stereo Matching

Real-time Stereo Vision System Using Adaptive Weight Cost Aggregation Approach

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

LESC: Superpixel Cut-Based Local Expansion for Accurate Stereo Matching

Stereo Matching Accelerator With Re-Computation Scheme and Data-Reused Pipeline for Autonomous Vehicles

Hardware Acceleration for an Accurate Stereo Vision System Using Mini-Census Adaptive Support Region

Sparse LIDAR Measurement Fusion with Joint Updating Cost for Fast Stereo Matching

Hybrid stereo matching by dynamic programming with enhanced cost entry for real-time depth generation

Improved real-time three-dimensional stereo matching with local consistency

Hardware Solution of Real-Time Depth Estimation Based on Stereo Vision

Local Expansion Moves for Stereo Matching Based on Random Sample Consensus Confidence

Adaptive Disparity Computation Using Local and Non-Local Cost Aggregations

HLocalExp-CM: confidence map by hierarchical local expansion moves for accurate stereo matching

Local PatchMatch Based on Superpixel Cut for Efficient High-resolution Stereo Matching

Research and implementation of adaptive stereo matching algorithm based on ZYNQ

Expanding Sparse LiDAR Depth and Guiding Stereo Matching for Robust Dense Depth Estimation

Hardware accelerator for an accurate local stereo matching algorithm using binary neural network

Fast Stereo Matching Algorithm Based on Adaptive Window

TinyStereo: A Tiny Coarse-to-Fine Framework for Vision-Based Depth Estimation on Embedded GPUs

Stereo Matching Method with Integrated Geometric Encoding for Disparity Refinement

Lightweight multi-scale convolutional neural network for real time stereo matching