Face recognition from a single image per person

TanXiaoyang,ChenSongcan,ZhouZhi-Hua,ZhangFuyan

IF: 8

2006-01-01

Pattern Recognition

Abstract:One of the main challenges faced by the current face recognition techniques lies in the difficulties of collecting samples. Fewer samples per person mean less laborious effort for collecting them, ...

What problem does this paper attempt to address?

Face Recognition from a Single Image Per Person: A Survey.

Xiaoyang Tan,Songcan Chen,Zhi-Hua Zhou,Fuyan Zhang

DOI: https://doi.org/10.1016/j.patcog.2006.03.013

IF: 8

2006-01-01

Pattern Recognition

Abstract:One of the main challenges faced by the current face recognition techniques lies in the difficulties of collecting samples. Fewer samples per person mean less laborious effort for collecting them, lower cost for storing and processing them. Unfortunately, many reported face recognition techniques rely heavily on the size and representative of training set, and most of them will suffer serious performance drop or even fail to work if only one training sample per person is available to the systems. This situation is called ''one sample per person'' problem: given a stored database of faces, the goal is to identify a person from the database later in time in any different and unpredictable poses, lighting, etc. from just one image. Such a task is very challenging for most current algorithms due to the extremely limited representative of training sample. Numerous techniques have been developed to attack this problem, and the purpose of this paper is to categorize and evaluate these algorithms. The prominent algorithms are described and critically analyzed. Relevant issues such as data collection, the influence of the small sample size, and system evaluation are discussed, and several promising directions for future research are also proposed in this paper.
Towards Mask-robust Face Recognition.

Tao Feng,Liangpeng Xu,Hangjie Yuan,Yongfei Zhao,Mingqian Tang,Mang Wang

DOI: https://doi.org/10.1109/iccvw54120.2021.00173

2021-01-01

Abstract:In this paper, we focus on the problem of mask-robust face recognition. Facial mask usually covers a major part of face, causing a significant reduction in extracting effective features. Due to such restriction, even the most advanced face recognition models are confronted with significant challenges. In light of this, this paper attempts to provide a reliable solution. Specifically, we introduce a mask-to-face image blending approach based on UV texture mapping, and a self-learning based cleaning pipeline for processing noisy training datasets. Then, considering the impacts of the long-tail distribution and hard faces samples, a loss function named Balanced Curricular Loss is introduced. Together with a bag of tricks is briefly presented. Experimental results show that the proposed solution separately achieved 84.528% @ Mask and 88.355% @ MR-ALL in InsightFace ms1m Track, which ranks 3rd when the paper submitted.
Face Verification System Based on Texture Feature with Single Sample Per Person

Wang Xiongjing,Yang Wenming,Liao Qingmin

DOI: https://doi.org/10.1117/12.920217

2012-01-01

Abstract:This paper introduces a face verification system implementation. In feature extraction, the algorithm is based on a classical texture descriptor, Local Binary Patterns (LBP). In decision making, a new method is proposed to determine the Client Dependent threshold (CD-th). Compared with the traditional fixed threshold, it significantly reduces error rate. Moreover, a symmetry factor is defined to increase frontal face detection rate. And a storage mode is designed to reduce time consumption in feature extraction. The implemented face verification system requires only one sample per person, and overcomes the difficulties appearing in multi-sample face verification system, including image capture problem, storage limitation and time-consumption. The experiments demonstrate the effectiveness of our proposed system.
Face identification using reference-based features with message passing model

Wei Shen,Bo Wang,Yueming Wang,Xiang Bai,Longin Jan Latecki

DOI: https://doi.org/10.1016/j.neucom.2012.06.032

IF: 6

2013-01-01

Neurocomputing

Abstract:In this paper, we propose a system for face identification. Given two query face images, our task is to tell whether or not they are of the same person. The main contribution of this paper comes from two aspects: (1) We adopt the one-shot similarity kernel [35] for learning the similarity of two face images. The learned similarity measures are then used to map a face image to reference images. (2) We propose a graph-based method for selecting an optimal set of reference images. Instead of directly working on the image features, we use the learned similarity to the reference images as the new features and compute the corresponding matching score of the two query images. Our approach is effective and easy to implement. We show encouraging and favorable results on the ''Labeled Faces in the Wild'' - a challenging data set of faces.
Face recognition using non-negative matrix factorization with a single sample per person in a large database

F. Nikan,H. Hassanpour

DOI: https://doi.org/10.1007/s11042-020-09394-4

IF: 2.577

2020-08-01

Multimedia Tools and Applications

Abstract:There are various face recognition techniques in literature, which are faced with challenges such as occlusion, pose variation, illumination, and facial expressions. Existing methods often perform well when their database is small, or multiple samples per person exist. However, face recognition methods with just one reference sample per person may not work well, especially on a large database. To address this problem, this paper proposes a scheme to extract features from facial images. Using Non-negative Matrix Factorization (NMF), basic features are extracted from the face structure. The matrix of images is decomposed into basis matrix (W) and weight matrix (H). The basis matrix contains several versions of mouths, noses and other facial parts, where the various versions are in different locations or forms. Hence, to recognize a facial image in the database, searching is done on the weight matrices feature set. In this research, to more precisely form the structural elements, a separate basis matrix is constructed for the upper and lower parts of the facial images from the database. Also the images are enhanced using pre-processing techniques including histogram equalization, image intensity, and contrast limited adaptive histogram. The FERET database with 990 single images per person was used to evaluate the proposed method. Experimental results show that the proposed method can achieve a recognition rate close to 93%.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Robust Face Recognition from a Single Training Image per Person with Kernel-Based SOM-Face

Xiaoyang Tan,Songcan Chen,Zhi-hua Zhou,Fuyan Zhang

DOI: https://doi.org/10.1007/978-3-540-28647-9_141

2004-01-01

Abstract:In this paper, a kernel-based SOM-face method is proposed to recognize expression variant faces under the situation of only one training image per person. Based on the localization of the face, an unsupervised kernel-SOM learning procedure is carried out to capture the common local features and the non-Euclidean structure of the image data, so that a compact and robust representation of the face can be obtained. Experiments on the FERET face database show that the Kernel-based SOM-face method can obtain higher recognition performance than the regular SOM-face method.
Adaptive Generic Learning for Face Recognition from A Single Sample Per Person

Yu Su,Shiguang Shan,Xilin Chen,Wen Gao

DOI: https://doi.org/10.1109/cvpr.2010.5539990

2010-01-01

Abstract:Real-world face recognition systems often have to face the single sample per person (SSPP) problem, that is, only a single training sample for each person is enrolled in the database. In this case, many of the popular face recognition methods fail to work well due to the inability to learn the discriminatory information specific to the persons to be identified. To address this problem, in this paper, we propose an Adaptive Generic Learning (AGL) method, which adapts a generic discriminant model to better distinguish the persons with single face sample. As a specific implementation of the AGL, a Coupled Linear Representation (CLR) algorithm is proposed to infer, based on the generic training set, the within-class scatter matrix and the class mean of each person given its single enrolled sample. Thus, the traditional Fisher's Linear Discriminant (FLD) can be applied to SSPP task. Experiments on the FERET and a challenging passport face database show that the proposed method can achieve better results compared with other common solutions to the SSPP problem.
A New Face Recognition Algorithm Based on Dictionary Learning for a Single Training Sample Per Person

Yang Liu,Ian J. Wassell

DOI: https://doi.org/10.5244/c.29.69

2015-01-01

Abstract:The number of the training samples per person has a significant impact on face recognition (FR) performance. For the single training sample per person (STSPP) problem, most traditional FR algorithms exhibit performance degradation owing to the limited information available to predict the variance of the query sample. This paper proposes a new method for the STSPP problem in FR, namely the Learn-Generate-Classify (LGC) method. The overall framework of the LGC method is presented in Fig.1.
Similarity mapping for robust face recognition via a single training sample per person

Qin Li,Xiaoshuang Shi,Zhenhua Guo

DOI: https://doi.org/10.1016/j.patrec.2019.10.015

IF: 4.757

2019-01-01

Pattern Recognition Letters

Abstract:•A robust face recognition method using one training sample per person.•Generating new training samples by preserving variations of face image instead of eliminating the variations.•Face recognition is formed as an image patch-based sparse representation problem.•State-of-the-art performance under illumination changes, occlusion and facial expressions.
Deep Convolutional Neural Network Used in Single Sample per Person Face Recognition

Junying Zeng,Xiaoxiao Zhao,Junying Gan,Chaoyun Mai,Yikui Zhai,Fan Wang

DOI: https://doi.org/10.1155/2018/3803627

2018-08-23

Abstract:Face recognition (FR) with single sample per person (SSPP) is a challenge in computer vision. Since there is only one sample to be trained, it makes facial variation such as pose, illumination, and disguise difficult to be predicted. To overcome this problem, this paper proposes a scheme combined traditional and deep learning (TDL) method to process the task. First, it proposes an expanding sample method based on traditional approach. Compared with other expanding sample methods, the method can be used easily and conveniently. Besides, it can generate samples such as disguise, expression, and mixed variation. Second, it uses transfer learning and introduces a well-trained deep convolutional neural network (DCNN) model and then selects some expanding samples to fine-tune the DCNN model. Third, the fine-tuned model is used to implement experiment. Experimental results on AR face database, Extend Yale B face database, FERET face database, and LFW database demonstrate that TDL achieves the state-of-the-art performance in SSPP FR.
Deep Learning Based Single Sample Face Recognition: a Survey

Liu Fan,Chen Delong,Wang Fei,Li Zewen,Xu Feng

DOI: https://doi.org/10.1007/s10462-022-10240-2

IF: 9.588

2022-01-01

Artificial Intelligence Review

Abstract:Face recognition has long been an active research area in the field of artificial intelligence, particularly since the rise of deep learning in recent years. In some practical situations, each identity has only a single sample available for training. Face recognition under this situation is referred to as single sample face recognition and poses significant challenges to the effective training of deep models. Therefore, in recent years, researchers have attempted to unleash more potential of deep learning and improve the model recognition performance in the single sample situation. While several comprehensive surveys have been conducted on traditional single sample face recognition approaches, emerging deep learning based methods are rarely involved in these reviews. Accordingly, we focus on the deep learning-based methods in this paper, classifying them into virtual sample methods and generic learning methods. In the former category, virtual images or virtual features are generated to benefit the training of the deep model. In the latter one, additional multi-sample generic sets are used. There are three types of generic learning methods: combining traditional methods and deep features, improving the loss function, and improving network structure, all of which are covered in our analysis. Moreover, we review face datasets that have been commonly used for evaluating single sample face recognition models and go on to compare the results of different types of models. Additionally, we discuss problems with existing single sample face recognition methods, including identity information preservation in virtual sample methods, domain adaption in generic learning methods. Furthermore, we regard developing unsupervised methods is a promising future direction, and point out that the semantic gap as an important issue that needs to be further considered.
Learning Structured Sparse Representation For Single Sample Face Recognition

Fan Liu,Feng Xu,Yuhua Ding,Sai Yang

DOI: https://doi.org/10.1109/iwbf.2018.8401561

2018-01-01

Abstract:In this paper, we propose a robust sparse representation method to address single sample per person problem by simultaneously exploiting the local and global structure of data. Considering the fact that most sparse representation methods use each testing sample separately and ignore the prior information from testing data, we seek the sparse representation of all testing samples together to capture the global structure of data. Moreover, we adopt an intra-class variance dictionary to describe various facial changes that can not be captured by the single training sample. To make use of local structure, we divide each face image into some blocks consisting of overlapped patches and assume the overlapped patches in a local block are different samples from the same class, which makes their coefficients have row-wise sparse structure. Finally, by imposing group sparsity constraint and sparsity constraint respectively on the coefficients corresponding to the training patches dictionary and variance dictionary, we obtain more discriminative sparse representation, whose coefficients can be directly utilized for classification. Experimental results on three public databases not only demonstrate effectiveness of the proposed approach but also show robustness to various facial variation.
Single Image Subspace For Face Recognition

Jun Liu,Songcan Chen,Zhi-Hua Zhou,Xiaoyang Tan

DOI: https://doi.org/10.1007/978-3-540-75690-3_16

2007-01-01

Abstract:Small sample size and severe facial variation are two challenging problems for face recognition. In this paper, we propose the SIS (Single Image Subspace) approach to address these two problems. To deal with the former one, we represent each single image as a subspace spanned by its synthesized (shifted) samples, and employ a newly designed subspace distance metric to measure the distance of subspaces. To deal with the latter one, we divide a face image into several regions, compute the contribution scores of the training samples based on the extracted subspaces in each region, and aggregate the scores of all the regions to yield the ultimate recognition result. Experiments on well-known face databases such as AR, Extended YALE and FERET show that the proposed approach outperforms some renowned methods not only in the scenario of one training sample per person, but also in the scenario of multiple training samples per person with significant facial variations.
Adaptive Linear Regression for Single-Sample Face Recognition

Biao Wang,Weifeng Li,Zhimin Li,Qingmin Liao

DOI: https://doi.org/10.1016/j.neucom.2013.02.004

IF: 6

2013-01-01

Neurocomputing

Abstract:The single sample per person problem (SSPP) is quite common in real-world face recognition applications. In such circumstance, the lack of enough training samples often results in poor generalization ability for majority of the existing state-of-the-art methods. To address this problem, in this paper, a fairly simple but effective approach, called adaptive linear regression classifier (ALRC), is presented based on the simple observation that similar subjects have similar intra-personal variations. ALRC is a linear model representing a probe image as a linear combination of the single class-specific gallery and the intra-personal variations adaptively pulled from his/her kNNs in an auxiliary generic training set with multiple samples per person. ALRC can be easily employed with a regularized least square estimator and the decision is ruled in favor of the class with the minimum reconstruction error. Experimental results on AR and FERET face datasets show that ALRC outperforms several state-of-the-art approaches and demonstrates promising abilities against variations including expression, illumination and disguise.
Discriminative Multimanifold Analysis for Face Recognition from a Single Training Sample Per Person

Jiwen Lu,Yap-Peng Tan,Gang Wang

DOI: https://doi.org/10.1109/iccv.2011.6126464

IF: 23.6

2013-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Conventional appearance-based face recognition methods usually assume that there are multiple samples per person (MSPP) available for discriminative feature extraction during the training phase. In many practical face recognition applications such as law enhancement, e-passport, and ID card identification, this assumption, however, may not hold as there is only a single sample per person (SSPP) enrolled or recorded in these systems. Many popular face recognition methods fail to work well in this scenario because there are not enough samples for discriminant learning. To address this problem, we propose in this paper a novel discriminative multimanifold analysis (DMMA) method by learning discriminative features from image patches. First, we partition each enrolled face image into several nonoverlapping patches to form an image set for each sample per person. Then, we formulate the SSPP face recognition as a manifold-manifold matching problem and learn multiple DMMA feature spaces to maximize the manifold margins of different persons. Finally, we present a reconstruction-based manifold-manifold distance to identify the unlabeled subjects. Experimental results on three widely used face databases are presented to demonstrate the efficacy of the proposed approach.
Single-Sample Face Recognition Based on Shared Generative Adversarial Network

Yuhua Ding,Zhenmin Tang,Fei Wang

DOI: https://doi.org/10.3390/math10050752

IF: 2.4

2022-02-26

Mathematics

Abstract:Single-sample face recognition is a very challenging problem, where each person has only one labeled training sample. It is difficult to describe unknown facial variations. In this paper, we propose a shared generative adversarial network (SharedGAN) to expand the gallery dataset. Benefiting from the shared decoding network, SharedGAN requires only a small number of training samples. After obtaining the generated samples, we join them into a large public dataset. Then, a deep convolutional neural network is trained on the new dataset. We use the well-trained model for feature extraction. With the deep convolutional features, a simple softmax classifier is trained. Our method has been evaluated on AR, CMU-PIE, and FERET datasets. Experimental results demonstrate the effectiveness of SharedGAN and show its robustness for single sample face recognition.

mathematics
One-Shot Face Recognition Based on Multiple Classifiers Training

Vuliem Khong,Ziyu Zeng,Lu Fang,Shengjin Wang

DOI: https://doi.org/10.1145/3457682.3457748

2021-02-26

Abstract:One-shot face recognition is a challenging problem which requires recognizing novel identities from only one seen face image. One-shot classes are simply neglected because of the lack of training samples. Therefore, these classes contribute less to the improvement of face recognition performance. The main goal of one-shot face recognition task is to use the novel face samples to enhance the ability of network not only in close-set classify, but also in open-set face verification. In this paper, Base data and Novel data is trained separately with two classifiers to reduce the impact of data imbalance. We propose Confidence Constrain Loss to train classifiers in parallel and get better classifiers fusion in the test phase. Besides, we use data augmentation with 3D face reconstruction to obtain a variety of oneshot set's training samples. Thus, our method can effectively increase the recognition accuracy in the novel set without reducing recognition accuracy in base set. Experiments on MS-celeb-1M low-shot dataset demonstrate that our method achieve state-of-the-art which has 98.90% coverage at precision=99% without using external data.
Making FLDA Applicable to Face Recognition with One Sample Per Person

SC Chen,J Liu,ZH Zhou

DOI: https://doi.org/10.1016/j.patcog.2003.12.010

IF: 8

2004-01-01

Pattern Recognition

Abstract:In face recognition, the Fisherface approach based on Fisher linear discriminant analysis (FLDA) has obtained some success. However, FLDA fails when each person just has one training face sample available because of nonexistence of the intra-class scatter. In this paper, we propose to partition each face image into a set of sub-images with the same dimensionality, therefore obtaining multiple training samples for each class, and then apply FLDA to the set of newly produced samples. Experimental results on the FERET face database show that the proposed approach is feasible and better in recognition performance than E(PC)2A.
Face Recognition from Multiple Images Per Subject

Yang Mu,Henry Z. Lo,Wei Ding,Dacheng Tao

DOI: https://doi.org/10.1145/2647868.2655054

2014-01-01

Abstract:For face recognition, we show that knowing that each subject corresponds to multiple face images can improve classification performance. For domains such as video surveillance, it is easy to deduce which group of images belong to the same subject; in domains such as family album identification, we lose group membership information but there is still a group of images for each subject. We define these two types of problems as multiple faces per subject . In this paper, we propose a Bipart framework to take advantage of this group information in the testing set as well as in the training set. From these two sources of information, two models are learned independently and combined to form a unified discriminative distance space. Furthermore, this framework is generalized to allow both subspace learning and distance metric learning methods to take advantage of this group information. Bipart is evaluated on the multiple faces per subject problem using several benchmark datasets, including video and static image data, subjects of various ages, various lighting conditions, and many facial expressions. Comparisons against state-of-the-art distance and subspace learning methods demonstrate much better performance when utilizing group information with the Bipart framework.
Face Recognition Based on Multi-Wavelet and Sparse Representation.

Lijian Zhou,Yukai Xu,Zhe-Ming Lu,Tingyuan Nie

2014-01-01

Abstract:The feature dimension and redundancy can reduce the face recognition speed and rate, the shading and light changing can heavily affect the face recognition effect. So the first key to face recognition is how to effectively extract face features because the face image contains a lot of redundant information. Multi-wavelet transform has symmetry, orthogonality, compact support and high vanishing moments simultaneously, which can present the face features better than scalar wavelet in each band. By analyzing all the multi-wavelet frequency band components, we can see that the low frequency component of the face image can provide the main feature of a face, and the high frequency compo- nents often contain some noises caused by the external interference. Therefore, the low frequency component is often adopted to form the face features. For solving the second problem, we choose the sparse representation recognition method , which has strong ro- bustness to shading and light changing problem. So this paper proposes a face recognition method, which combines multi-wavelet with sparse representation recognition. First, we extract the face features by multi-wavelet, then establish a fully redundant dictionary, and use the sparse representation recognition algorithm for face recognition at last. Based on the YALE, the AR and the FERET face databases, the experimental results show that our method can effectively recognize faces, reduce the dimension of features and has good robustness.

Face recognition from a single image per person

Face Recognition from a Single Image Per Person: A Survey.

Towards Mask-robust Face Recognition.

Face Verification System Based on Texture Feature with Single Sample Per Person

Face identification using reference-based features with message passing model

Face recognition using non-negative matrix factorization with a single sample per person in a large database

Robust Face Recognition from a Single Training Image per Person with Kernel-Based SOM-Face

Adaptive Generic Learning for Face Recognition from A Single Sample Per Person

A New Face Recognition Algorithm Based on Dictionary Learning for a Single Training Sample Per Person

Similarity mapping for robust face recognition via a single training sample per person

Deep Convolutional Neural Network Used in Single Sample per Person Face Recognition

Deep Learning Based Single Sample Face Recognition: a Survey

Learning Structured Sparse Representation For Single Sample Face Recognition

Single Image Subspace For Face Recognition

Adaptive Linear Regression for Single-Sample Face Recognition

Discriminative Multimanifold Analysis for Face Recognition from a Single Training Sample Per Person

Single-Sample Face Recognition Based on Shared Generative Adversarial Network

One-Shot Face Recognition Based on Multiple Classifiers Training

Making FLDA Applicable to Face Recognition with One Sample Per Person

Face Recognition from Multiple Images Per Subject

Face Recognition Based on Multi-Wavelet and Sparse Representation.