Abstract:In this paper, we propose a facial attractiveness prediction method from deep learning and three‐dimensional perspectives. The feature extraction networks for texture, point cloud, and mesh are delicately designed. A more discriminative face representation is derived by feature fusion. During network training, the cyclical learning rate with an improved range test is introduced, so as to alleviate the difficulty in hyperparameter setting. Extensive experiments indicate that the improved learning rate and feature fusion cooperatively promote the prediction results. Facial attractiveness prediction is an important research topic in the computer vision community. It not only contributes to the development of interdisciplinary research in psychology and sociology, but also provides fundamental technical support for applications like aesthetic medicine and social media. With the advances in 3D data acquisition and feature representation, this paper aims to investigate the facial attractiveness from deep learning and three‐dimensional perspectives. The 3D faces are first processed to unwrap the texture images and refine the raw meshes. The feature extraction networks for texture, point cloud, and mesh are then delicately designed, considering the characteristics of different types of data. A more discriminative face representation is derived by feature fusion for the final attractiveness prediction. During network training, the cyclical learning rate with an improved range test is introduced, so as to alleviate the difficulty in hyperparameter setting. Extensive experiments are conducted on a 3D FAP benchmark, where the results demonstrate the significance of deep feature fusion and enhanced learning rate in cooperatively facilitating the performance. Specifically, the fusion of texture image and point cloud achieves the best overall prediction, with PC, MAE, and RMSE of 0.7908, 0.4153, and 0.5231, respectively.

Three-dimensional (3D) Facial Recognition and Prediction.

3D Face Recognition Via Conformal Representation

An Efficient 3D Face Recognition Approach Based on the Fusion of Novel Local Low-Level Features

Robust 3D Face Recognition by Local Shape Difference Boosting

Feature Level Analysis for 3D Facial Expression Recognition.

2D Representation of Facial Surfaces for Multi-Pose 3D Face Recognition.

Learning Effective Features for 3D Face Recognition

The 3D Face Recognition Algorithm Fusing Multi-geometry Features

Real-Time 3d Face Recognition With The Integration Of Depth And Intensity Images

3D Face Recognition Based on Intrinsic Features.

Comparison of 2 D / 3 D Features and Their Adaptive Score Level Fusion for 3 D Face Recognition

Expression-Robust 3d Face Recognition Based on Feature-Level Fusion and Feature-Region Fusion

Efficient 3D face recognition handling facial expression and hair occlusion

3d Face Recognition Based On Decision Fusion

3D Face Recognition Based on Principal Axes Registration and Fusing Features

Mixed 2D-3D information for face recognition

Comparison of 2D/3D Features and Their Adaptive Score Level Fusion for 3D Face Recognition

Three-Dimension Face Recognition Based on Information Fusion

3D facial attractiveness prediction based on deep feature fusion

A fast and robust 3D face recognition approach based on deeply learned face representation.

Deep Representation of Facial Geometric and Photometric Attributes for Automatic 3D Facial Expression Recognition