Abstract:In today's society, beauty is more than just aesthetics, it has a profound impact on many aspects of life, including social interactions, self-confidence, and job opportunities. To quantify this beauty, the field of Facial Beauty Prediction (FBP) is gaining traction. In the field of FBP, traditional methods often fall short due to their reliance on absolute beauty scores, which do not fully capture the subjective nature of human aesthetic perception. This study presents a novel approach to address this gap through the development of Anchor-Net, a self-supervised learning model that predicts differences in relative beauty scores by comparing images. The objective of this research is to offer a more nuanced understanding of facial beauty by employing a reference image (anchor) alongside a prediction image, thereby aligning closer with how humans perceive aesthetic differences. To construct Anchor-Net, we first developed a Base model that predicts beauty scores using a model pre-trained with VGGFace2. This Base model was then adapted into Anchor-Net, which is designed to train on the difference in beauty scores between a reference image and a prediction image. Our methodology involved two transfer learning steps to leverage the strengths of pre existing models while tailoring them to our specific research problem. The experimental validation of Anchor-Net was conducted on the SCUT-FBP5500 benchmark dataset, utilizing a 6:4 training-testing split and 5-fold cross-validation to ensure robust testing of the model's predictive capabilities. The results demonstrate that Anchor-Net outperforms other state-of-the-art deep learning algorithms on all metrics: Pearson Correlation (PC), Mean Absolute Error (MAE), and Root Mean Square Error (RMSE). Anchor-Net outperformed other models with a PC of 0.0021, MAE of 0.0055, and RMSE of 0.0065 on a 6:4 training-test split. On average, it achieved a PC of 0.0034, MAE of 0.0155, and RMSE of 0.0135 on 5-fold cross-validation. This research proposes a novel approach to FBP and suggests a broader application of relative comparison methodologies in fields where absolute measurements fall short.

Broad Siamese Network for Facial Beauty Prediction

Anchor-Net: Distance-Based Self-Supervised Learning Model for Facial Beauty Prediction

Learning feature alignment across attribute domains for improving facial beauty prediction

Bio-Inspired Deep Attribute Learning Towards Facial Aesthetic Prediction

MetaFBP: Learning to Learn High-Order Predictor for Personalized Facial Beauty Prediction

Ethically aligned Deep Learning: Unbiased Facial Aesthetic Prediction

A New Face Beauty Prediction Model Based on Blocked LBP

Beauty3DFaceNet: Deep Geometry and Texture Fusion for 3D Facial Attractiveness Prediction.

Facial Expression Recognition from a Single Face Image Based on Deep Learning and Broad Learning

SCUT-FBP5500: A Diverse Benchmark Dataset for Multi-Paradigm Facial Beauty Prediction

A new humanlike facial attractiveness predictor with cascaded fine-tuning deep learning model

Face Anti-Spoofing with Human Material Perception

SPRBF-ABLS: a novel attention-based broad learning systems with sparse polynomial-based radial basis function neural networks

Understanding Beauty via Deep Facial Features

Sense Beauty Via Face, Dressing, And/or Voice

Multi-Stream Facial Adaptive Network for Expression Recognition from a Single Image

Neural Image Beauty Predictor Based on Bradley-Terry Model

ISFB-GAN: Interpretable semantic face beautification with generative adversarial network

Machine Learning-Based Facial Beauty Prediction and Analysis of Frontal Facial Images Using Facial Landmarks and Traditional Image Descriptors

Facial expression recognition method based on deep convolutional neural network combined with improved LBP features

SAANet: Siamese Action-Units Attention Network for Improving Dynamic Facial Expression Recognition