Abstract:Firstly, we construct a multi‐region disparity selection module based on angular patch, which selects specific regions for generating angular patch, achieving representative sub‐angular patch by balancing different regions. Secondly, different from traditional guided deformable convolution, it leverages colour prior information to learn the aggregation of sampling points, which enhances the deformable convolution ability by learning deformation parameters and fitting irregular windows. Finally, to achieve high‐precision LF depth estimation, the authors have developed a network architecture based on the proposed multi‐region disparity selection and guided optimisation module. Light field (LF) depth estimation is a key task with numerous practical applications. However, achieving high‐precision depth estimation in challenging scenarios, such as occlusions and detailed regions (e.g. fine structures and edges), remains a significant challenge. To address this problem, the authors propose a LF depth estimation network based on multi‐region selection and guided optimisation. Firstly, we construct a multi‐region disparity selection module based on angular patch, which selects specific regions for generating angular patch, achieving representative sub‐angular patch by balancing different regions. Secondly, different from traditional guided deformable convolution, the guided optimisation leverages colour prior information to learn the aggregation of sampling points, which enhances the deformable convolution ability by learning deformation parameters and fitting irregular windows. Finally, to achieve high‐precision LF depth estimation, the authors have developed a network architecture based on the proposed multi‐region disparity selection and guided optimisation module. Experiments demonstrate the effectiveness of network on the HCInew dataset, especially in handling occlusions and detailed regions.

Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimation

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

OccCasNet: Occlusion-aware Cascade Cost Volume for Light Field Depth Estimation

Light-field-depth-estimation Network Based on Epipolar Geometry and Image Segmentation.

Accurate Disparity Estimation in Light Field Using Ground Control Points.

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Disparity Estimation for Focused Light Field Camera Using Cost Aggregation in Micro-Images

Toward Real-World Light Field Depth Estimation: A Noise-Aware Paradigm Using Multi-Stereo Disparity Integration

Fast Light-field Disparity Estimation with Multi-disparity-scale Cost Aggregation.

LF-DWNet: Robust Depth Estimation Network for Light Field with Disparity Warping

High precision light field image depth estimation via multi‐region attention enhanced network

Efficiency–Accuracy Trade-Off in Light Field Estimation with Cost Volume Construction and Aggregation

Depth Estimation for Light-Field Images Using Stereo Matching and Convolutional Neural Networks

Light Field Depth Estimation Exploiting Linear Structure in EPI

Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

Depth Estimation Via Light Field Camera with a Hybrid Stereo Matching Method

Take Your Model Further: A General Post-refinement Network for Light Field Disparity Estimation Via BadPix Correction.

Zero-Shot Depth Estimation from Light Field Using A Convolutional Neural Network

Pixel-wise Matching Cost Function for Robust Light Field Depth Estimation

Cascade Light Field Disparity Estimation Network Based on Unsupervised Deep Learning