Abstract:Facial beauty prediction (FBP) aims to develop a system to assess facial attractiveness automatically. Through prior research and our own observations, it has become evident that attribute information, such as gender and race, is a key factor leading to the distribution discrepancy in the FBP data. Such distribution discrepancy hinders current conventional FBP models from generalizing effectively to unseen attribute domain data, thereby discounting further performance improvement. To address this problem, in this paper, we exploit the attribute information to guide the training of convolutional neural networks (CNNs), with the final purpose of implicit feature alignment across various attribute domain data. To this end, we introduce the attribute information into convolution layer and batch normalization (BN) layer, respectively, as they are the most crucial parts for representation learning in CNNs. Specifically, our method includes: 1) Attribute-guided convolution (AgConv) that dynamically updates convolutional filters based on attributes by parameter tuning or parameter rebirth; 2) Attribute-guided batch normalization (AgBN) is developed to compute the attribute-specific statistics through an attribute guided batch sampling strategy; 3) To benefit from both approaches, we construct an integrated framework by combining AgConv and AgBN to achieve a more thorough feature alignment across different attribute domains. Extensive qualitative and quantitative experiments have been conducted on the SCUT-FBP, SCUT-FBP5500 and HotOrNot benchmark datasets. The results show that AgConv significantly improves the attribute-guided representation learning capacity and AgBN provides more stable optimization. Owing to the combination of AgConv and AgBN, the proposed framework (Ag-Net) achieves further performance improvement and is superior to other state-of-the-art approaches for FBP.

Collaborative Learning Network For Face Attribute Prediction

Joint Multi-Feature Fusion and Attribute Relationships for Facial Attribute Prediction.

Deep Learning Face Attributes in the Wild

Faceknow: Facial Expression Recognition by a Global-Local Network with a Sub-Images-Related Contextual Attention Mechanism

Grouped Multi-Task CNN for Facial Attribute Recognition

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network.

Attribute-aware Convolutional Neural Networks for Facial Beauty Prediction

Improving Facial Attribute Recognition by Group and Graph Learning

A new humanlike facial attractiveness predictor with cascaded fine-tuning deep learning model

FR-ANet: A Face Recognition Guided Facial Attribute Classification Network

Learning feature alignment across attribute domains for improving facial beauty prediction

Multi-task Learning of Cascaded CNN for Facial Attribute Classification.

BLAN: Bi-directional Ladder Attentive Network for Facial Attribute Prediction

Scattering-based Hybrid Network for Facial Attribute Classification

Facial Attribute Classification by Deep Mining Inter‐attribute Correlations

Real-time Face Attributes Recognition Via HPGC: Horizontal Pyramid Global Convolution

Learning an attention-aware parallel sharing network for facial attribute recognition

Exploring Correlations in Multiple Facial Attributes Through Graph Attention Network

Robust RGB-D Face Recognition Using Attribute-Aware Loss

Features-Enhanced Multi-Attribute Estimation with Convolutional Tensor Correlation Fusion Network

Multimodal 2D+3D Facial Expression Recognition with Deep Fusion Convolutional Neural Network