Abstract:Firstly, we construct a multi‐region disparity selection module based on angular patch, which selects specific regions for generating angular patch, achieving representative sub‐angular patch by balancing different regions. Secondly, different from traditional guided deformable convolution, it leverages colour prior information to learn the aggregation of sampling points, which enhances the deformable convolution ability by learning deformation parameters and fitting irregular windows. Finally, to achieve high‐precision LF depth estimation, the authors have developed a network architecture based on the proposed multi‐region disparity selection and guided optimisation module. Light field (LF) depth estimation is a key task with numerous practical applications. However, achieving high‐precision depth estimation in challenging scenarios, such as occlusions and detailed regions (e.g. fine structures and edges), remains a significant challenge. To address this problem, the authors propose a LF depth estimation network based on multi‐region selection and guided optimisation. Firstly, we construct a multi‐region disparity selection module based on angular patch, which selects specific regions for generating angular patch, achieving representative sub‐angular patch by balancing different regions. Secondly, different from traditional guided deformable convolution, the guided optimisation leverages colour prior information to learn the aggregation of sampling points, which enhances the deformable convolution ability by learning deformation parameters and fitting irregular windows. Finally, to achieve high‐precision LF depth estimation, the authors have developed a network architecture based on the proposed multi‐region disparity selection and guided optimisation module. Experiments demonstrate the effectiveness of network on the HCInew dataset, especially in handling occlusions and detailed regions.

Blind Quality Evaluator of Light Field Images by Group-Based Representations and Multiple Plane-Oriented Perceptual Characteristics

Spatial-angular features based no-reference light field quality assessment

No-Reference Light Field Image Quality Assessment Based on Spatial-Angular Measurement

No-Reference Light Field Image Quality Assessment Based on Micro-Lens Image

Light Field Image Quality Assessment With Auxiliary Learning Based on Depthwise and Anglewise Separable Convolutions

Tensor Oriented No-Reference Light Field Image Quality Assessment

Objective Quality Assessment Metrics for Light Field Image Based on Textural Features

A New Benchmark Database and Objective Metric for Light Field Image Quality Evaluation

A No-Reference Image Quality Assessment Metric by Multiple Characteristics of Light Field Images

Image Quality Evaluation of Light Field Image Based on Macro-Pixels and Focus Stack

Light Field Image Quality Assessment: An Overview

PVBLiF: A Pseudo Video-Based Blind Quality Assessment Metric for Light Field Image

LFACon: Introducing Anglewise Attention to No-Reference Quality Assessment in Light Field Space

Light field quality assessment based on aggregation learning of multiple visual features

Light Field Image Quality Assessment Via the Light Field Coherence.

Objective Quality Assessment of Lenslet Light Field Image Based on Focus Stack

View Position Prior-Supervised Light Field Angular Super-Resolution Network with Asymmetric Feature Extraction and Spatial-Angular Interaction.

Breaking the Spatio-Angular Trade-off for Light Field Super-Resolution via LSTM Modelling on Epipolar Plane Images.

BELIF: BLIND QUALITY EVALUATOR OF LIGHT FIELD IMAGE WITH TENSOR STRUCTURE VARIATION INDEX

A Multi-Order Derivative Feature-Based Quality Assessment Model for Light Field Image

High precision light field image depth estimation via multi‐region attention enhanced network