Abstract:Stereopsis has widespread appeal in robotics as it is the predominant way by which living beings perceive depth to navigate our 3D world. Event cameras are novel bio-inspired sensors that detect per-pixel brightness changes asynchronously, with very high temporal resolution and high dynamic range, enabling machine perception in high-speed motion and broad illumination conditions. The high temporal precision also benefits stereo matching, making disparity (depth) estimation a popular research area for event cameras ever since its inception. Over the last 30 years, the field has evolved rapidly, from low-latency, low-power circuit design to current deep learning (DL) approaches driven by the computer vision community. The bibliography is vast and difficult to navigate for non-experts due its highly interdisciplinary nature. Past surveys have addressed distinct aspects of this topic, in the context of applications, or focusing only on a specific class of techniques, but have overlooked stereo datasets. This survey provides a comprehensive overview, covering both instantaneous stereo and long-term methods suitable for simultaneous localization and mapping (SLAM), along with theoretical and empirical comparisons. It is the first to extensively review DL methods as well as stereo datasets, even providing practical suggestions for creating new benchmarks to advance the field. The main advantages and challenges faced by event-based stereo depth estimation are also discussed. Despite significant progress, challenges remain in achieving optimal performance in not only accuracy but also efficiency, a cornerstone of event-based computing. We identify several gaps and propose future research directions. We hope this survey inspires future research in this area, by serving as an accessible entry point for newcomers, as well as a practical guide for seasoned researchers in the community.

Intel RealSense Stereoscopic Depth Cameras

IR Stereo RealSense: Decreasing Minimum Range of Navigational Assistance for Visually Impaired Individuals.

DoCam: Depth Sensing with an Optical Image Stabilization Supported RGB Camera.

Intel® RealSense™ SR300 Coded Light Depth Camera

Improving RealSense by Fusing Color Stereo Vision and Infrared Stereo Vision for the Visually Impaired

RealSense = Real Heart Rate: Illumination Invariant Heart Rate Estimation from Videos

Perspectives of RealSense and ZED Depth Sensors for Robotic Vision Applications

A Learned Stereo Depth System for Robotic Manipulation in Homes

Scalable Multi-View Stereo Camera Array for Real-Time Image Capture and 3D Display in Real-World Applications

Real-time Depth Extraction and Multi-View Rendering Algorithm Based on Kinect

Robust 3D Reconstruction with an RGB-D Camera

On 3D Reconstruction Using RGB-D Cameras

Depth Estimation by Combining Binocular Stereo and Monocular Structured-Light

A High Spatial Resolution Depth Sensing Method Based on Binocular Structured Light

Analysis of RGB-D camera technologies for supporting different facial usage scenarios

A High Resolution Multi-exposure Stereoscopic Image & Video Database of Natural Scenes

Event-based Stereo Depth Estimation: A Survey

High-Resolution Depth Maps Based on TOF-Stereo Fusion

Stereo Hybrid Event-Frame (SHEF) Cameras for 3D Perception

Low-cost Gaze and Pulse Analysis Using RealSense

RGBD-based Real-time Volumetric Reconstruction System: Architecture Design and Implementation