Abstract:Computational prediction of facial aesthetics has attracted ever-increasing research focus, which has wide range of prospects in multimedia applications. The key challenge lies in extracting discriminative and perception-aware features to characterize the facial beautifulness. To this end, the existing schemes simply adopt a direct feature mapping, which relies on handcraft-designed low-level features that cannot reflect human-level aesthetic perception. In this paper, we present a systematic framework towards designing biology-inspired, discriminative representation for facial aesthetic prediction. First, we design a group of biological experiments that adopt eye tracker to identify spatial regions of interest during the facial aesthetic judgments of subjects, which forms a Bio-inspired Facial Aesthetic Ontology (Bio-FAO) and is made public available. Second, we adopt the cutting-edge convolutional neural network to train a set of Bio-inspired Attribute features, termed Bio-AttriBank, which forms a mid-level interpretable representation corresponding to the aforementioned Bio-FAO. For a given image, the facial aesthetic prediction is then formulated as a classification problem over the Bio-AttriBank descriptor responses, which well bridges the affective gap, and provides explainable evidences on why/how a face is beautiful or not. We have carried out extensive experiments on both JAFFE and FaceWarehouse datasets, with comparisons to a set of state-of-the-art and alternative approaches. Superior performance gains in the experiments have demonstrated the merits of the proposed scheme.

A novel method for evaluating facial attractiveness

Computational Facial Attractiveness Prediction by Aesthetics-Aware Features

Dynamic Facial Features in Positive-Emotional Speech for Identification of Depressive Tendencies

Predicting Facial Attractiveness from Colour Cues: A New Analytic Framework

Understanding Beauty via Deep Facial Features

A computational approach to investigating facial attractiveness factors using geometric morphometric analysis and deep learning

Beauty3DFaceNet: Deep Geometry and Texture Fusion for 3D Facial Attractiveness Prediction.

Machine Learning-Based Facial Beauty Prediction and Analysis of Frontal Facial Images Using Facial Landmarks and Traditional Image Descriptors

Evaluation of Facial Attractiveness for Patients with Malocclusion: A Machine-Learning Technique Employing Procrustes

SCUT-FBP: A Benchmark Dataset for Facial Beauty Perception

A New Face Beauty Prediction Model Based on Blocked LBP

Towards Decrypting Attractiveness Via Multi-Modality Cues.

Which Face is More Attractive?

Face beautification: Beyond makeup transfer

A new humanlike facial attractiveness predictor with cascaded fine-tuning deep learning model

Bio-Inspired Deep Attribute Learning Towards Facial Aesthetic Prediction

A Comparative Study on the Perceived Attractiveness of Oriental and South Asian Faces

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Developing an Artificial Intelligence (A.I)-based descriptor of facial appearance that fits with the assessments of makeup experts

Beauty is Here

Learning efficient facial landmark model for human attractiveness analysis