Abstract:Dense disparity map extraction is one of the most active research areas in computer vision. It tries to recover three-dimensional information from a stereo image pair. A large variety of algorithms has been developed to solve stereo matching problems. This paper proposes a new stereo matching algorithm, capable of generating the disparity map in real-time and with high accuracy. A novel stereo matching approach is based on per-pixel difference adjustment for the absolute differences, gradient matching and rank transform. The selected cost metrics are aggregated using guided filter. The disparity calculation is performed using dynamic programming with self-adjusting and adaptive penalties to improve disparity map accuracy. Our approach exploits mean-shift image segmentation and refinement technique to reach higher accuracy. In addition, a parallel high-performance graphics hardware based on Compute Unified Device Architecture is used to implement this method. Our algorithm runs at 36 frames per second on 640×480\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$640 \times 480$$\end{document} video with 64 disparity levels. Over 707 million disparity evaluations per second (MDE/s) are achieved in our current implementation. In terms of accuracy and runtime, our algorithm ranks the third place on Middlebury stereo benchmark in quarter resolution up to the submitting.

Virtual support window for adaptive-weight stereo matching.

Real-time Stereo Vision System Using Adaptive Weight Cost Aggregation Approach

Fast Stereo Matching Algorithm Based on Adaptive Window

Space-temporal stereo matching for dynamic scene

Analysis of adaptive support-weight based stereo matching for hardware realization

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

Hybrid stereo matching by dynamic programming with enhanced cost entry for real-time depth generation

Dynamic Limited-Search Matching Algorithm Based on Geometric Properties of Stereo Imaging

An Efficient Stereo Disparity Estimation Method Based on Region Information

Adaptive Disparity Computation Using Local and Non-Local Cost Aggregations

An Improved Adaptive Window Stereo Matching Algorithm

Stereo matching algorithm using improved guided filtering

Stereo Matching by Filtering-Based Disparity Propagation

Segmentation-based dense stereo matching algorithm for virtual view synthesis

Dynamic programming with adaptive and self-adjusting penalty for real-time accurate stereo matching

Stereo Matching Using Local Plane Fitting in Confidence-Based Support Window.

Stereo Matching by Adaptive Weighting Selection Based Cost Aggregation

Temporally Consistent Stereo Matching

Sparse LIDAR Measurement Fusion with Joint Updating Cost for Fast Stereo Matching

Local Stereo Matching with Side Window

Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving