Abstract:Light field cameras and multi-camera arrays have emerged as promising solutions for accurately estimating depth by passively capturing light information. This is possible because the 3D information of a scene is embedded in the 4D light field geometry. Commonly, depth estimation methods extract this information relying on gradient information, heuristic-based optimisation models, or learning-based approaches. This paper focuses mainly on explicitly understanding and exploiting 4D geometrical cues for light field depth estimation. Thus, a novel method is proposed, based on a non-learning-based optimisation approach for depth estimation that explicitly considers surface normal accuracy and occlusion regions by utilising a fully explainable 4D geometric model of the light field. The 4D model performs depth/disparity estimation by determining the orientations and analysing the intersections of key 2D planes in 4D space, which are the images of 3D-space points in the 4D light field. Experimental results show that the proposed method outperforms both learning-based and non-learning-based state-of-the-art methods in terms of surface normal angle accuracy, achieving a Median Angle Error on planar surfaces, on average, 26.3\% lower than the state-of-the-art, and still being competitive with state-of-the-art methods in terms of Mean Squared Error $\vc{\times}$ 100 and Badpix 0.07.

Depth Estimation of Complex Geometry Scenes from Light Fields

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Three Dimensional Surface Reconstruction Based on Light Field Imaging

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Light-field-depth-estimation Network Based on Epipolar Geometry and Image Segmentation.

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

Light Field Depth Estimation Exploiting Linear Structure in EPI

Light Field Depth Estimation via Epipolar Plane Image Analysis and Locally Linear Embedding

Depth Estimation by Analyzing Intensity Distribution for Light-Field Cameras.

Depth Estimation from Light Field Using Graph-Based Structure-Aware Analysis.

Depth Extraction of Low-Texture Region Using A Light Field Camera

Depth Map Estimation with 4D Light Fields Using Confocal Stereo

Iterative Occlusion-Aware Light Field Depth Estimation using 4D Geometrical Cues

Enhanced Depth Estimation for Hand-Held Light Field Cameras

Fast Response Aggregation for Depth Estimation Using Light Field Camera

Depth Fused from Intensity Range and Blur Estimation for Light-Field Cameras

How Depth Estimation in Light Fields Can Benefit from Super-Resolution?

Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

Ghost-free Reconstruction of Multi-Layer Scenes Using Light-Field Method

Enhanced Depth Estimation for Light Field Cameras by Variable-Patch-Size Tensor Extraction