Abstract:Computational prediction of facial aesthetics has attracted ever-increasing research focus, which has wide range of prospects in multimedia applications. The key challenge lies in extracting discriminative and perception-aware features to characterize the facial beautifulness. To this end, the existing schemes simply adopt a direct feature mapping, which relies on handcraft-designed low-level features that cannot reflect human-level aesthetic perception. In this paper, we present a systematic framework towards designing biology-inspired, discriminative representation for facial aesthetic prediction. First, we design a group of biological experiments that adopt eye tracker to identify spatial regions of interest during the facial aesthetic judgments of subjects, which forms a Bio-inspired Facial Aesthetic Ontology (Bio-FAO) and is made public available. Second, we adopt the cutting-edge convolutional neural network to train a set of Bio-inspired Attribute features, termed Bio-AttriBank, which forms a mid-level interpretable representation corresponding to the aforementioned Bio-FAO. For a given image, the facial aesthetic prediction is then formulated as a classification problem over the Bio-AttriBank descriptor responses, which well bridges the affective gap, and provides explainable evidences on why/how a face is beautiful or not. We have carried out extensive experiments on both JAFFE and FaceWarehouse datasets, with comparisons to a set of state-of-the-art and alternative approaches. Superior performance gains in the experiments have demonstrated the merits of the proposed scheme.

A NEW FACE FEATURE POINT MATRIX BASED ON GEOMETRIC FEATURES AND ILLUMINATION MODELS FOR FACIAL ATTRACTION ANALYSIS

A new facial feature based on the fusion of texture and shape characteristics

Improved Active Shape Model for Facial Feature Localization Using Poem Descriptor

Facial Feature Localization Using Robust Active Shape Model and POEM Descriptors

Learning efficient facial landmark model for human attractiveness analysis

Fast face modeling based on features and flexible mesh model

A Novel Method Of Extracting Facial Feature Points Based On 3d Rotation And Asm

Real-Time facial expression recognition system based on HMM and feature point localization

Computational Facial Attractiveness Prediction by Aesthetics-Aware Features

Automatic facial expression recognition on a single 3D face by exploring shape deformation.

Facial Expression Animation Based on Physical Model

Novel Facial Features Segmentation Algorithm

Video-Based Facial Animation with Detailed Appearance Texture

Video Tracked Facial Expression Animation

Automatic 3D Face Modeling Using 2D Active Appearance Models

Face identification using reference-based features with message passing model

Beauty3DFaceNet: Deep Geometry and Texture Fusion for 3D Facial Attractiveness Prediction.

Using Feature Points and Angles Between Them to Recognise Facial Expression by a Neural Network Approach

Predicting Facial Attractiveness from Colour Cues: A New Analytic Framework

Unifying Geometric Features and Facial Action Units for Improved Performance of Facial Expression Analysis

Bio-Inspired Deep Attribute Learning Towards Facial Aesthetic Prediction