Joint Distortion Restoration and Quality Feature Learning for No-Reference Image Quality Assessment

Jifan Yang,Zhongyuan Wang,Baojin Huang,Jiaxin Ai,Yuhong Yang,Zixiang Xiong
DOI: https://doi.org/10.1145/3649899
2024-02-28
Abstract:No-reference image quality assessment (NR-IQA) methods inspired by the free energy principle, improve the accuracy of image quality prediction by simulating the human brain’s repair process for distorted images. However, existing methods use separate optimisation schemes for distortion restoration and quality prediction, which undermines the accurate mapping of feature representations to quality scores. To address this issue, we propose a joint restoration and quality feature learning NR-IQA (RQFL-IQA) method to jointly tackle distortion image restoration and quality prediction within a unified framework. To accurately establish the quality reconstruction relationship between distorted and restored images, a hybrid loss function based on pixel-wise and structure-wise representations is used to improve the restoration capability of the image restoration network. The proposed RQFL-IQA exploits rich labels, including restored images and quality scores, to enable the model to learn more discriminative features and establish a more accurate mapping from feature representation to quality scores. In addition, to avoid the impact of poor restoration on quality prediction, we propose a module with a cleaning function to reweight the fusion of restored and primitive features to achieve more perceptual consistency in feature fusion. Experimental results on public IQA datasets show that the proposed RQFL-IQA is superior over existing methods.
computer science, information systems, theory & methods, software engineering
What problem does this paper attempt to address?