Abstract:In this paper, we propose a facial attractiveness prediction method from deep learning and three‐dimensional perspectives. The feature extraction networks for texture, point cloud, and mesh are delicately designed. A more discriminative face representation is derived by feature fusion. During network training, the cyclical learning rate with an improved range test is introduced, so as to alleviate the difficulty in hyperparameter setting. Extensive experiments indicate that the improved learning rate and feature fusion cooperatively promote the prediction results. Facial attractiveness prediction is an important research topic in the computer vision community. It not only contributes to the development of interdisciplinary research in psychology and sociology, but also provides fundamental technical support for applications like aesthetic medicine and social media. With the advances in 3D data acquisition and feature representation, this paper aims to investigate the facial attractiveness from deep learning and three‐dimensional perspectives. The 3D faces are first processed to unwrap the texture images and refine the raw meshes. The feature extraction networks for texture, point cloud, and mesh are then delicately designed, considering the characteristics of different types of data. A more discriminative face representation is derived by feature fusion for the final attractiveness prediction. During network training, the cyclical learning rate with an improved range test is introduced, so as to alleviate the difficulty in hyperparameter setting. Extensive experiments are conducted on a 3D FAP benchmark, where the results demonstrate the significance of deep feature fusion and enhanced learning rate in cooperatively facilitating the performance. Specifically, the fusion of texture image and point cloud achieves the best overall prediction, with PC, MAE, and RMSE of 0.7908, 0.4153, and 0.5231, respectively.

Beauty3DFaceNet: Deep Geometry and Texture Fusion for 3D Facial Attractiveness Prediction.

3D facial attractiveness prediction based on deep feature fusion

SADRNet: Self-Aligned Dual Face Regression Networks for Robust 3D Dense Face Alignment and Reconstruction

Bio-Inspired Deep Attribute Learning Towards Facial Aesthetic Prediction

A new humanlike facial attractiveness predictor with cascaded fine-tuning deep learning model

Deep Facial Features for Personalized Attractiveness Prediction

Deep Rank Learning For Facial Attractiveness

Understanding Beauty via Deep Facial Features

Facial Attractiveness Prediction Using Psychologically Inspired Convolutional Neural Network (PI-CNN)

Computational Facial Attractiveness Prediction by Aesthetics-Aware Features

Dynamic Attentive Convolution for Facial Beauty Prediction

Automatic Facial Attractiveness Prediction by Deep Multi-Task Learning.

Label Distribution-Based Facial Attractiveness Computation by Deep Residual Learning

Geometric Prior Guided Hybrid Deep Neural Network for Facial Beauty Analysis

Ethically aligned Deep Learning: Unbiased Facial Aesthetic Prediction

Predicting Facial Beauty Without Landmarks

Improving Facial Attractiveness Prediction Via Co-attention Learning

Putative Ratios of Facial Attractiveness in a Deep Neural Network

Novel Multi-Feature Fusion Facial Aesthetic Analysis Framework.

A novel facial attractiveness evaluation system based on face shape, facial structure features and skin

A Landmark-Based Data-Driven Approach on 2.5D Facial Attractiveness Computation.