Abstract:With the recent development of deep convolutional neural networks and large-scale datasets, deep face recognition has made remarkable progress and been widely used in various applications. However, unlike the existing public face datasets, in many real-world scenarios of face recognition, the depth of the training dataset is shallow, which means that only two face images are available for each ID. With the non-uniform increase of samples, such issue is converted to a more general case, known as long-tail face learning, which suffers from data imbalance and intra-class diversity dearth simultaneously. These adverse conditions damage the training and result in the decline of model performance. Based on Semi-Siamese Training, we introduce an advanced solution, named Multi-Agent Semi-Siamese Training (MASST), to address these problems. MASST includes a probe network and multiple gallery agents-the former aims to encode the probe features, and the latter constitutes a stack of networks that encode the prototypes (gallery features). For each training iteration, the gallery network, which is sequentially rotated from the stack, and the probe network form a pair of Semi-Siamese networks. We give the theoretical and empirical analysis that, given the long-tail (or shallow) data and training loss, MASST smooths the loss landscape and satisfies the Lipschitz continuity with the help of multiple agents and the updating gallery queue. The proposedmethod is out of extra-dependency, and thus can be easily integrated with the existing loss functions and network architectures. It is worth noting that although multiple gallery agents are employed for training, only the probe network is needed for inference, without increasing the inference cost. Extensive experiments and comparisons demonstrate the advantages of MASST for long-tail and shallow face learning.

Matrix-Structural Learning (MSL) of Cascaded Classifier from Enormous Training Set

Bilateral Structure Based Matrix Regression Classification for Face Recognition

End-to-End Spatial Transform Face Detection and Recognition

MMSVC: an Efficient Unsupervised Learning Approach for Large-Scale Datasets.

Training a Multi-Exit Cascade with Linear Asymmetric Classification for Efficient Object Detection

Online Kernel-Based Structured Output SVM for Early Expression Detection

A cascaded mixture SVM classifier for object detection

Dynamic Cascades For Face Detection

Using DSCB: A Depthwise Separable Convolution Block Rebuild MTCNN for Face Detection.

Linear Asymmetric Classifier for cascade detectors

Three-fold Structured Classifier Design Based on Matrix Pattern.

How to train a classifier based on the huge face database?

Face Image Modeling by Multilinear Subspace Analysis with Missing Values

MSFD:Multi-Scale Receptive Field Face Detector

Multi-face detection algorithm suitable for video surveillance

Improved Training Algorithms to Reduced Set Vector Machine and Adaboost Cascade Classifier for Face Detection

Multiview Structural Large Margin Classifier and Its Safe Acceleration Strategy

Efficiently Learning a Detection Cascade with Sparse Eigenvectors

Multi-Agent Semi-Siamese Training for Long-Tail and Shallow Face Learning

Improving Detector Of Viola And Jones Through Svm

Enhancing Training Set for Face Detection Based on SVM