Abstract:Deep Neural Network (DNN) has recently achieved outstanding performance in a variety of computer vision tasks, including facial attribute classification. The great success of classifying facial attributes with DNN often relies on a massive amount of labelled data. However, in real-world applications, labelled data are only provided for some commonly used attributes (such as age, gender); whereas, unlabelled data are available for other attributes (such as attraction, hairline). To address the above problem, we propose a novel deep transfer neural network method based on multi-label learning for facial attribute classification, termed FMTNet, which consists of three sub-networks: the Face detection Network (FNet), the Multi-label learning Network (MNet) and the Transfer learning Network (TNet). Firstly, based on the Faster Region-based Convolutional Neural Network (Faster R-CNN), FNet is fine-tuned for face detection. Then, MNet is fine-tuned by FNet to predict multiple attributes with labelled data, where an effective loss weight scheme is developed to explicitly exploit the correlation between facial attributes based on attribute grouping. Finally, based on MNet, TNet is trained by taking advantage of unsupervised domain adaptation for unlabelled facial attribute classification. The three sub-networks are tightly coupled to perform effective facial attribute classification. A distinguishing characteristic of the proposed FMTNet method is that the three sub-networks (FNet, MNet and TNet) are constructed in a similar network structure. Extensive experimental results on challenging face datasets demonstrate the effectiveness of our proposed method compared with several state-of-the-art methods.

Hierarchical Multi-Task Network For Race, Gender And Facial Attractiveness Recognition

Multi-Task Network and Optimization for Face Detection and Attribute Analysis

A New Deep Learning Method for Multi-label Facial Expression Recognition Based on Local Constraint Features

GEME: Dual-stream Multi-Task GEnder-based Micro-Expression Recognition.

Automatic Facial Attractiveness Prediction by Deep Multi-Task Learning.

Multi-Task Learning For Face Identification And Attribute Estimation

Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approach

A Privacy-Preserving Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition

Enhancing Facial Classification and Recognition using 3D Facial Models and Deep Learning

HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition

UFaceNet: Research on Multi-Task Face Recognition Algorithm Based on CNN.

Classifier Shared Deep Network with Multi-Hierarchy Loss for Low Resolution Face Recognition

Discriminative Deep Multi-Task Learning for Facial Expression Recognition.

Facial Emotion Recognition: A multi-task approach using deep learning

Multi-Task Learning With Knowledge Transfer For Facial Attribute Classification

Deep collaborative multi-task network: A human decision process inspired model for hierarchical image classification

Multi-label learning based deep transfer neural network for facial attribute classification

Beauty3DFaceNet: Deep Geometry and Texture Fusion for 3D Facial Attractiveness Prediction.

Deep learning for gender recognition

Learning Saliency Features for Face Detection and Recognition Using Multi-task Network.

Cross-dataset Face Analysis Based on Multi-Task Learning.