Going the Extra Mile in Face Image Quality Assessment: A Novel Database and Model

Shaolin Su,Hanhe Lin,Vlad Hosu,Oliver Wiedemann,Jinqiu Sun,Yu Zhu,Hantao Liu,Yanning Zhang,Dietmar Saupe

2023-07-30

Abstract:An accurate computational model for image quality assessment (IQA) benefits many vision applications, such as image filtering, image processing, and image generation. Although the study of face images is an important subfield in computer vision research, the lack of face IQA data and models limits the precision of current IQA metrics on face image processing tasks such as face superresolution, face enhancement, and face editing. To narrow this gap, in this paper, we first introduce the largest annotated IQA database developed to date, which contains 20,000 human faces -- an order of magnitude larger than all existing rated datasets of faces -- of diverse individuals in highly varied circumstances. Based on the database, we further propose a novel deep learning model to accurately predict face image quality, which, for the first time, explores the use of generative priors for IQA. By taking advantage of rich statistics encoded in well pretrained off-the-shelf generative models, we obtain generative prior information and use it as latent references to facilitate blind IQA. The experimental results demonstrate both the value of the proposed dataset for face IQA and the superior performance of the proposed model.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

This paper aims to address several key issues in the field of face image quality assessment (IQA):

1. **Lack of dedicated face IQA datasets**: Although the quality assessment of face images is an important subfield in computer vision research, there is currently a lack of sufficient face IQA datasets, which limits the accuracy of existing IQA metrics in face processing tasks.

2. **Proposing a new face IQA model**: To address this deficiency, the authors have constructed a large-scale face image quality assessment database (GFIQA-20k), containing 20,000 face images of different individuals in various conditions. Based on this database, they propose a new deep learning model for accurately predicting face image quality.

3. **Utilizing generative priors**: The new model explores the use of generative priors for IQA for the first time. By leveraging the rich statistical information in pre-trained generative models, generative priors are extracted as potential references, thereby improving the performance of blind IQA.

Through these efforts, the paper not only validates the value of the proposed database in assessing face image quality but also demonstrates the superior performance of the new model in accurate prediction.