Multi-exposure fusion light field image quality assessment with motion region detection

Keke Yao,G. Jiang,Yueli Cui,Jun Cheng,Yeyao Chen,Mei Yu
DOI: https://doi.org/10.1117/12.3025865
2024-02-21
Abstract:Compared to ordinary light field image (LFI), multi-exposure fusion light field image (MEF-LFI) can record more visual information and details of scene. However, MEF-LFI also produces distortions while enhancing LFI, leading to quality degradation. Therefore, it is crucial to develop effective MEF-LFI quality assessment models. This paper proposes a multi-exposure fusion light field image quality assessment method with motion region detection, which considers that the artifact distortion of MEF-LFI synthesized from dynamic scenes usually occurs in motion regions. A motion region detection module is designed for detecting artifact distortion in MEF-LFI. Considering that tone mapping (TM) operations can cause texture distortion in MEF-LFI, the spectral texture distortion feature extraction module and the spatial domain gradient feature extraction module are designed by combining Curvelet transform and Scharr operator, respectively. Due to the distortion of color shift in MEF-LFI, the color feature extraction module is constructed with the characteristics of HSI color model. In addition, considering the unique angular distortion of MEF-LFI, the angular feature extraction module is designed with Log-Gabor operator. Finally, the extracted feature vector is input into the support vector regression model to predicate the quality for MEF-LFI. The experimental results show that the proposed method is superior to the representative quality assessment methods and has better consistency with the human visual perception.
Computer Science,Engineering
What problem does this paper attempt to address?