Abstract:Light field (LF) depth estimation is a crucial task with numerous practical applications. However, mainstream methods based on the multi-view stereo (MVS) are resource-intensive and time-consuming as they need to construct a finer cost volume. To address this issue and achieve a better trade-off between accuracy and efficiency, we propose an occlusion-aware cascade cost volume for LF depth (disparity) estimation. Our cascaded strategy reduces the sampling number while keeping the sampling interval constant during the construction of a finer cost volume. We also introduce occlusion maps to enhance accuracy in constructing the occlusion-aware cost volume. Specifically, we first obtain the coarse disparity map through the coarse disparity estimation network. Then, the sub-aperture images (SAIs) of side views are warped to the center view based on the initial disparity map. Next, we propose photo-consistency constraints between the warped SAIs and the center SAI to generate occlusion maps for each SAI. Finally, we introduce the coarse disparity map and occlusion maps to construct an occlusion-aware refined cost volume, enabling the refined disparity estimation network to yield a more precise disparity map. Extensive experiments demonstrate the effectiveness of our method. Compared with state-of-the-art methods, our method achieves a superior balance between accuracy and efficiency and ranks first in terms of MSE and Q25 metrics among published methods on the HCI 4D benchmark. The code and model of the proposed method are available at <a class="link-external link-https" href="https://github.com/chaowentao/OccCasNet" rel="external noopener nofollow">this https URL</a>.

Light Field Depth Estimation Using Occlusion-Aware Consistency Analysis.

Occlusion-Model Guided Anti-Occlusion Depth Estimation in Light Field

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Anti-Noise Light Field Depth Estimation Using Inline Occlusion Handling

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

OccCasNet: Occlusion-aware Cascade Cost Volume for Light Field Depth Estimation

Depth Estimation from Light Field Using Graph-Based Structure-Aware Analysis.

Efficiency–Accuracy Trade-Off in Light Field Estimation with Cost Volume Construction and Aggregation

Iterative Occlusion-Aware Light Field Depth Estimation using 4D Geometrical Cues

Depth Estimation by Analyzing Intensity Distribution for Light-Field Cameras.

Light-field-depth-estimation Network Based on Epipolar Geometry and Image Segmentation.

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Enhanced Depth Estimation for Hand-Held Light Field Cameras

Defocusing Response Function Optimization in Depth Estimation of Boundary Complex Light Field Image

Enhanced Depth Estimation for Light Field Cameras by Variable-Patch-Size Tensor Extraction

Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

Light Field Depth Estimation Exploiting Linear Structure in EPI

Frequency Descriptor based Light Field Depth Estimation

Occlusion-aware depth estimation for light field using multi-orientation EPIs.

Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimation