Abstract:Stereopsis has widespread appeal in robotics as it is the predominant way by which living beings perceive depth to navigate our 3D world. Event cameras are novel bio-inspired sensors that detect per-pixel brightness changes asynchronously, with very high temporal resolution and high dynamic range, enabling machine perception in high-speed motion and broad illumination conditions. The high temporal precision also benefits stereo matching, making disparity (depth) estimation a popular research area for event cameras ever since its inception. Over the last 30 years, the field has evolved rapidly, from low-latency, low-power circuit design to current deep learning (DL) approaches driven by the computer vision community. The bibliography is vast and difficult to navigate for non-experts due its highly interdisciplinary nature. Past surveys have addressed distinct aspects of this topic, in the context of applications, or focusing only on a specific class of techniques, but have overlooked stereo datasets. This survey provides a comprehensive overview, covering both instantaneous stereo and long-term methods suitable for simultaneous localization and mapping (SLAM), along with theoretical and empirical comparisons. It is the first to extensively review DL methods as well as stereo datasets, even providing practical suggestions for creating new benchmarks to advance the field. The main advantages and challenges faced by event-based stereo depth estimation are also discussed. Despite significant progress, challenges remain in achieving optimal performance in not only accuracy but also efficiency, a cornerstone of event-based computing. We identify several gaps and propose future research directions. We hope this survey inspires future research in this area, by serving as an accessible entry point for newcomers, as well as a practical guide for seasoned researchers in the community.

Literature Survey on Stereo Vision Disparity Map Algorithms

Real-time Stereo Vision System Using Adaptive Weight Cost Aggregation Approach

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Stixel Based Urban Scene Representation by Stereo Vision

Stereo Visual Odometry from Disparity Space in Dynamic Environments

Dynamic Limited-Search Matching Algorithm Based on Geometric Properties of Stereo Imaging

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

Dynamic programming with adaptive and self-adjusting penalty for real-time accurate stereo matching

An Efficient Adaptive Window Based Disparity Map Computation Algorithm by Dense Two Frame Stereo Correspondence

Adaptive Aggregation Based Cooperative Stereo Vision

An Efficient Stereo Disparity Estimation Method Based on Region Information

Adaptive Disparity Computation Using Local and Non-Local Cost Aggregations

Stereo Matching Method with Integrated Geometric Encoding for Disparity Refinement

Learning Local Event-based Descriptor for Patch-based Stereo Matching

Global Stereo Matching Algorithm Based on Disparity Range Estimation

Extracting Disparity Map from Bifocal Monocular Stereo Vision in a Novel Way

Event-based Stereo Depth Estimation: A Survey

Object Disparity

Stereo Matching with Cost Volume based Sparse Disparity Propagation

Disparity Estimation Based on the Combination of Depth Camera and Stereo Vision

A novel stereo matching pipeline with robustness and unfixed disparity search range