Abstract:In this paper, the challenge of fast stereo matching for embedded systems is tackled. Limited resources, e.g. memory and processing power, and most importantly real-time capability on embedded systems for robotic applications, do not permit the use of most sophisticated stereo matching approaches. The strengths and weaknesses of different matching approaches have been analyzed and a well-suited solution has been found in a Census-based stereo matching algorithm. The novelty of the algorithm used is the explicit adaption and optimization of the well-known Census transform in respect to embedded real-time systems in software. The most important change in comparison with the classic Census transform is the usage of a sparse Census mask which halves the processing time with nearly unchanged matching quality. This is due the fact that large sparse Census masks perform better than small dense masks with the same processing effort. The evidence of this assumption is given by the results of experiments with different mask sizes. Another contribution of this work is the presentation of a complete stereo matching system with its correlation-based core algorithm, the detailed analysis and evaluation of the results, and the optimized high speed realization on different embedded and PC platforms. The algorithm handles difficult areas for stereo matching, such as areas with low texture, very well in comparison to state-of-the-art real-time methods. It can successfully eliminate false positives to provide reliable 3D data. The system is robust, easy to parameterize and offers high flexibility. It also achieves high performance on several, including resource-limited, systems without losing the good quality of stereo matching. A detailed performance analysis of the algorithm is given for optimized reference implementations on various commercial of the shelf (COTS) platforms, e.g. a PC, a DSP and a GPU, reaching a frame rate of up to 75 fps for 640×480 images and 50 disparities. The matching quality and processing time is compared to other algorithms on the Middlebury stereo evaluation website reaching a middle quality and top performance rank. Additional evaluation is done by comparing the results with a very fast and well-known sum of absolute differences algorithm using several Middlebury datasets and real-world scenarios.

Bounding Box Matching: A Sparse Object-centric Correspondence Method for Stereo Vision

Bounding Box Matching: A Sparse Object-centric Correspondence Method for Stereo Vision

Object-Centric Stereo Matching for 3D Object Detection

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

Object Disparity

Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving

Canonical Voting: Towards Robust Oriented Bounding Box Detection in 3D Scenes

Stereo Matching with Cost Volume based Sparse Disparity Propagation

Parallax attention stereo matching network based on the improved group-wise correlation stereo network

Stereo matching algorithm using deep learning and edge-preserving filter for machine vision

Stereo Matching with Improved Radiometric Invariant Matching Cost and Disparity Refinement

Segment-Based Disparity Refinement With Occlusion Handling for Stereo Matching

Stereo Matching by Self-supervision of Multiscopic Vision.

Stereo Matching with Space-Constrained Cost Aggregation and Segmentation-Based Disparity Refinement

Improved real-time three-dimensional stereo matching with local consistency

An accurate stereo matching method based on color segments and edges

Bounding Box Disparity: 3D Metrics for Object Detection With Full Degree of Freedom

SCV-Stereo: Learning Stereo Matching from a Sparse Cost Volume

A fast stereo matching algorithm suitable for embedded real-time systems

Disparity Refinement Of Building Edges Using Robustly Matched Straight Lines For Stereo Matching

Stereo Frustums: a Siamese Pipeline for 3D Object Detection