Abstract:Light Field Image (LFI) records both angular and spatial information and provides immersive experiences for observers by rendering a scene from multiple perspectives. To cope with the resolution limitations of capture hardware, LFI angular reconstruction and spatial super-resolution are two widely-used methods, but they can also induce some special types of distortions, especially when two methods are adopted in combination. To this end, new challenges have been brought in assessing the quality of these distorted LFIs. In this paper, firstly, we conduct subjective experiments to evaluate the distorted LFI quality and present a novel perceptual quality assessment database with the associated subjective quality scores. Specifically, the proposed database focuses on the distortions introduced by deep learning-based LFI angular reconstruction and spatial super-resolution methods, individually and multiplely. Besides, in the case of multiple distortions, the adoption order of two distortions is taken into consideration. Further, our database presents three types of LFIs that suffer from distortions: real-world, dense synthesis, and sparse synthesis. As a result, the quality of distorted LFIs was subjectively assessed by 32 valid observers using the Pairwise Comparison (PC) protocol. Secondly, we develop a novel objective No-Reference (NR) metric for LFI quality evaluation, based on the features extracted from spatial gradients, angular-spatial statistics, and binocular disparity. Finally, a benchmark of the proposed metric and numerous state-of-the-art quality assessment metrics on the proposed database is presented. Experimental results demonstrate the superiority of the proposed metric over most existing metrics in various aspects. The proposed database and metric will be publicly available at https://github.com/ZhengyuZhang96/IETR-LFI.

Light Field Image Quality Assessment Based on Disentangling Bayesian Theory

No-Reference Light Field Image Quality Assessment Based on Spatial-Angular Measurement

Light Field Image Quality Assessment Via the Light Field Coherence.

A Multi-Order Derivative Feature-Based Quality Assessment Model for Light Field Image

Tensor Oriented No-Reference Light Field Image Quality Assessment

Objective Quality Assessment Metrics for Light Field Image Based on Textural Features

A No-Reference Image Quality Assessment Metric by Multiple Characteristics of Light Field Images

No-Reference Light Field Image Quality Assessment Based on Micro-Lens Image

Light field quality assessment based on aggregation learning of multiple visual features

Light Field Image Quality Assessment With Auxiliary Learning Based on Depthwise and Anglewise Separable Convolutions

Light Field Image Quality Assessment: An Overview

A New Benchmark Database and Objective Metric for Light Field Image Quality Evaluation

Image Quality Evaluation of Light Field Image Based on Macro-Pixels and Focus Stack

PVBLiF: A Pseudo Video-Based Blind Quality Assessment Metric for Light Field Image

A Light Field Image Quality Assessment Model Based on Symmetry and Depth Features

Blind Quality Evaluator of Light Field Images by Group-Based Representations and Multiple Plane-Oriented Perceptual Characteristics

BELIF: BLIND QUALITY EVALUATOR OF LIGHT FIELD IMAGE WITH TENSOR STRUCTURE VARIATION INDEX

LFACon: Introducing Anglewise Attention to No-Reference Quality Assessment in Light Field Space

Objective Quality Assessment of Lenslet Light Field Image Based on Focus Stack

Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

A Metric for Light Field Reconstruction, Compression, and Display Quality Evaluation