Abstract:Firstly, we construct a multi‐region disparity selection module based on angular patch, which selects specific regions for generating angular patch, achieving representative sub‐angular patch by balancing different regions. Secondly, different from traditional guided deformable convolution, it leverages colour prior information to learn the aggregation of sampling points, which enhances the deformable convolution ability by learning deformation parameters and fitting irregular windows. Finally, to achieve high‐precision LF depth estimation, the authors have developed a network architecture based on the proposed multi‐region disparity selection and guided optimisation module. Light field (LF) depth estimation is a key task with numerous practical applications. However, achieving high‐precision depth estimation in challenging scenarios, such as occlusions and detailed regions (e.g. fine structures and edges), remains a significant challenge. To address this problem, the authors propose a LF depth estimation network based on multi‐region selection and guided optimisation. Firstly, we construct a multi‐region disparity selection module based on angular patch, which selects specific regions for generating angular patch, achieving representative sub‐angular patch by balancing different regions. Secondly, different from traditional guided deformable convolution, the guided optimisation leverages colour prior information to learn the aggregation of sampling points, which enhances the deformable convolution ability by learning deformation parameters and fitting irregular windows. Finally, to achieve high‐precision LF depth estimation, the authors have developed a network architecture based on the proposed multi‐region disparity selection and guided optimisation module. Experiments demonstrate the effectiveness of network on the HCInew dataset, especially in handling occlusions and detailed regions.

Light Field Depth Estimation Exploiting Linear Structure in EPI

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Light Field Depth Estimation via Epipolar Plane Image Analysis and Locally Linear Embedding

Light-field-depth-estimation Network Based on Epipolar Geometry and Image Segmentation.

A Light Field Depth Estimation Algorithm by Edge Disparity Extraction

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

Occlusion-aware depth estimation for light field using multi-orientation EPIs.

EPI-based Oriented Relation Networks for Light Field Depth Estimation

Light Field Reconstruction using Efficient Pseudo 4D Epipolar-Aware Structure

EPI-Neighborhood Distribution Based Light Field Depth Estimation

Depth Estimation from Light Field Using Graph-Based Structure-Aware Analysis.

Depth Estimation by Analyzing Intensity Distribution for Light-Field Cameras.

Depth Extraction of Low-Texture Region Using A Light Field Camera

LF-fusion: Dense and Accurate 3D Reconstruction from Light Field Images

Light Field Reconstruction Using Deep Convolutional Network On Epi

Iterative Occlusion-Aware Light Field Depth Estimation using 4D Geometrical Cues

High precision light field image depth estimation via multi‐region attention enhanced network

Learning Sub-Pixel Disparity Distribution for Light Field Depth Estimation

Depth Map Estimation with 4D Light Fields Using Confocal Stereo