Abstract:This article proposes a zero-shot learning-based framework for light field depth estimation, which learns an end-to-end mapping solely from an input light field to the corresponding disparity map with neither extra training data nor supervision of groundtruth depth. The proposed method overcomes two major difficulties posed in existing learning-based methods and is thus much more feasible in practice. First, it saves the huge burden of obtaining groundtruth depth of a variety of scenes to serve as labels during training. Second, it avoids the severe domain shift effect when applied to light fields with drastically different content or captured under different camera configurations from the training data. On the other hand, compared with conventional non-learning-based methods, the proposed method better exploits the correlations in the 4D light field and generates much superior depth results. Moreover, we extend this zero-shot learning framework to depth estimation from light field videos. For the first time, we demonstrate that more accurate and robust depth can be estimated from light field videos by jointly exploiting the correlations across spatial, angular, and temporal dimensions. We conduct comprehensive experiments on both synthetic and real-world light field image datasets, as well as a self collected light field video dataset. Quantitative and qualitative results validate the superior performance of our method over the state-of-the-arts, especially for the challenging real-world scenes.

Enhanced Depth Estimation for Light Field Cameras by Variable-Patch-Size Tensor Extraction

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Depth Estimation by Analyzing Intensity Distribution for Light-Field Cameras.

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Depth Fused from Intensity Range and Blur Estimation for Light-Field Cameras

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Enhanced Depth Estimation for Hand-Held Light Field Cameras

Light-field-depth-estimation Network Based on Epipolar Geometry and Image Segmentation.

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

Depth Extraction from a Light Field Camera Using Weighted Median Filtering.

Light Field Depth Estimation Exploiting Linear Structure in EPI

Frequency Descriptor based Light Field Depth Estimation

Anti-Noise Light Field Depth Estimation Using Inline Occlusion Handling

EPI-Neighborhood Distribution Based Light Field Depth Estimation

Zero-Shot Depth Estimation from Light Field Using A Convolutional Neural Network

Depth Extraction of Low-Texture Region Using A Light Field Camera

Light Field Depth Estimation via Epipolar Plane Image Analysis and Locally Linear Embedding

Iterative Occlusion-Aware Light Field Depth Estimation using 4D Geometrical Cues

How Depth Estimation in Light Fields Can Benefit from Super-Resolution?

Occlusion-Model Guided Anti-Occlusion Depth Estimation in Light Field

Unsupervised Depth Estimation from Light Field Using a Convolutional Neural Network