Abstract:Light field cameras record not only the spatial information of observed scenes but also the directions of all incoming light rays. The spatial and angular information implicitly contain geometrical characteristics such as multi-view or epipolar geometry, which can be exploited to improve the performance of depth estimation. An Epipolar Plane Image (EPI), the unique 2D spatial-angular slice of the light field, contains patterns of oriented lines. The slope of these lines is associated with the disparity. Benefiting from this property of EPIs, some representative methods estimate depth maps by analyzing the disparity of each line in EPIs. However, these methods often extract the optimal slope of the lines from EPIs while ignoring the relationship between neighboring pixels, which leads to inaccurate depth map predictions. Based on the observation that an oriented line and its neighboring pixels in an EPI share a similar linear structure, we propose an end-to-end fully convolutional network (FCN) to estimate the depth value of the intersection point on the horizontal and vertical EPIs. Specifically, we present a new feature-extraction module, called Oriented Relation Module (ORM), that constructs the relationship between the line orientations. To facilitate training, we also propose a refocusing-based data augmentation method to obtain different slopes from EPIs of the same scene point. Extensive experiments verify the efficacy of learning relations and show that our approach is competitive to other state-of-the-art methods. The code and the trained models are available at <a class="link-external link-https" href="https://github.com/lkyahpu/EPI_ORM.git" rel="external noopener nofollow">this https URL</a>.

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Light-field-depth-estimation Network Based on Epipolar Geometry and Image Segmentation.

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Three Dimensional Surface Reconstruction Based on Light Field Imaging

Light Field Depth Estimation via Epipolar Plane Image Analysis and Locally Linear Embedding

A Learning-Based Method Using Data Augmentation for Light Field Salient Object Detection

Unsupervised Depth Estimation from Light Field Using a Convolutional Neural Network

Light Field Depth Estimation Exploiting Linear Structure in EPI

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

A Robust Monocular Depth Estimation Framework Based on Light-Weight ERF-Pspnet for Day-Night Driving Scenes

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

Zero-Shot Depth Estimation from Light Field Using A Convolutional Neural Network

Depth Estimation for Light-Field Images Using Stereo Matching and Convolutional Neural Networks

A Lightweight Depth Estimation Network for Wide-Baseline Light Fields

Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

Iterative Occlusion-Aware Light Field Depth Estimation using 4D Geometrical Cues

Light Field Reconstruction Using Convolutional Network on EPI and Extended Applications

Depth Estimation by Analyzing Intensity Distribution for Light-Field Cameras.

EPI-based Oriented Relation Networks for Light Field Depth Estimation

Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimation