Abstract:Dense disparity map extraction is one of the most active research areas in computer vision. It tries to recover three-dimensional information from a stereo image pair. A large variety of algorithms has been developed to solve stereo matching problems. This paper proposes a new stereo matching algorithm, capable of generating the disparity map in real-time and with high accuracy. A novel stereo matching approach is based on per-pixel difference adjustment for the absolute differences, gradient matching and rank transform. The selected cost metrics are aggregated using guided filter. The disparity calculation is performed using dynamic programming with self-adjusting and adaptive penalties to improve disparity map accuracy. Our approach exploits mean-shift image segmentation and refinement technique to reach higher accuracy. In addition, a parallel high-performance graphics hardware based on Compute Unified Device Architecture is used to implement this method. Our algorithm runs at 36 frames per second on 640×480\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$640 \times 480$$\end{document} video with 64 disparity levels. Over 707 million disparity evaluations per second (MDE/s) are achieved in our current implementation. In terms of accuracy and runtime, our algorithm ranks the third place on Middlebury stereo benchmark in quarter resolution up to the submitting.

Space-temporal stereo matching for dynamic scene

Dynamic Limited-Search Matching Algorithm Based on Geometric Properties of Stereo Imaging

Temporally Consistent Stereo Matching

Segment-based Continuous Stereo Matching

Stereo Visual Odometry from Disparity Space in Dynamic Environments

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

A Temporally Streamlined Optimization Method for Stereo Video Correspondence

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

An Efficient Stereo Disparity Estimation Method Based on Region Information

Improved real-time three-dimensional stereo matching with local consistency

Stereo Matching with Space-Constrained Cost Aggregation and Segmentation-Based Disparity Refinement

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Adaptive Disparity Computation Using Local and Non-Local Cost Aggregations

Using Temporal Correlation to Optimize Stereo Matching in Video Sequences

Segment-Based Disparity Refinement With Occlusion Handling for Stereo Matching

Stereo Matching with Improved Radiometric Invariant Matching Cost and Disparity Refinement

Stereo Matching by Incorporating Depth Cues

Match-Stereo-Videos: Bidirectional Alignment for Consistent Dynamic Stereo Matching

Dynamic programming with adaptive and self-adjusting penalty for real-time accurate stereo matching

Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving

Segmentation-based dense stereo matching algorithm for virtual view synthesis