Abstract:Dense disparity map extraction is one of the most active research areas in computer vision. It tries to recover three-dimensional information from a stereo image pair. A large variety of algorithms has been developed to solve stereo matching problems. This paper proposes a new stereo matching algorithm, capable of generating the disparity map in real-time and with high accuracy. A novel stereo matching approach is based on per-pixel difference adjustment for the absolute differences, gradient matching and rank transform. The selected cost metrics are aggregated using guided filter. The disparity calculation is performed using dynamic programming with self-adjusting and adaptive penalties to improve disparity map accuracy. Our approach exploits mean-shift image segmentation and refinement technique to reach higher accuracy. In addition, a parallel high-performance graphics hardware based on Compute Unified Device Architecture is used to implement this method. Our algorithm runs at 36 frames per second on 640×480\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$640 \times 480$$\end{document} video with 64 disparity levels. Over 707 million disparity evaluations per second (MDE/s) are achieved in our current implementation. In terms of accuracy and runtime, our algorithm ranks the third place on Middlebury stereo benchmark in quarter resolution up to the submitting.

A stereo matching in complex scene and occlusion handling model

Space-temporal stereo matching for dynamic scene

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

Hybrid stereo matching by dynamic programming with enhanced cost entry for real-time depth generation

Stereo Matching Via Disparity Estimation And Surface Modeling

Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving

Segment-Based Disparity Refinement With Occlusion Handling for Stereo Matching

Outlier detection and disparity refinement in stereo matching

Stereo matching algorithm using improved guided filtering

Stereo Matching with Space-Constrained Cost Aggregation and Segmentation-Based Disparity Refinement

Ambiguous Region Matching and Boundary Pixel Optimization for Stereo Computation

A Stereo Algorithm Using Edge-Based Orthogonal Dynamic Programming

An Efficient Stereo Disparity Estimation Method Based on Region Information

A Novel Cell Structure‐based Disparity Estimation for Unsupervised Stereo Matching

An Interleaving Updating Framework of Disparity and Confidence Map for Stereo Matching

Improved real-time three-dimensional stereo matching with local consistency

Edge-Preserving Stereo Matching Using Minimum Spanning Tree

PM-PM: PatchMatch with Potts Model for Object Segmentation and Stereo Matching.

A New Stereo Matching Method with Combination of Cross-Based Aggregation and Hierarchical Belief Propagation

Dynamic programming with adaptive and self-adjusting penalty for real-time accurate stereo matching