Face recognition using a novel image representation scheme and multi-scale local features

TaoQing-Chuan,LiuZhi-Ming,BebisGeorge,HussainMuhammad

2015-01-01

International Journal of Biometrics

Abstract:This paper presents a new method for improving face recognition performance under difficult conditions. Specifically, a new image representation scheme is proposed which is derived from the YCrQ co...

What problem does this paper attempt to address?

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Liao Haibin,Chen Qinghu,Wang Hongyong,Zhao Qianqian

DOI: https://doi.org/10.3969/j.issn.1001-3695.2010.05.100

2011-01-01

Abstract:Presently, face recognition has two main barriers, which are the variation of illumination, expression, pose and the occlusion and disguise respectively. The problem of robust identification human faces with varying expression and illumination, as well as occlusion and disguise will be researched in this paper. Firstly, singular value decomposition will be used for the face image, casting the singular value vector of test face image as a linear combination of the singular value vectors of face database and used deformable model representation; then, match optimization deformable model for solving combinatorial coefficient; finally, according to the sparse nature of coefficients for classification, and use slice-weighted strategy to further improve the robustness. Experimental results on Extended Yale B Database and AR Database shows that this method is very effective for face recognition and can significantly improve the robustness and stability of disguise and occlusion.
Towards Mask-robust Face Recognition.

Tao Feng,Liangpeng Xu,Hangjie Yuan,Yongfei Zhao,Mingqian Tang,Mang Wang

DOI: https://doi.org/10.1109/iccvw54120.2021.00173

2021-01-01

Abstract:In this paper, we focus on the problem of mask-robust face recognition. Facial mask usually covers a major part of face, causing a significant reduction in extracting effective features. Due to such restriction, even the most advanced face recognition models are confronted with significant challenges. In light of this, this paper attempts to provide a reliable solution. Specifically, we introduce a mask-to-face image blending approach based on UV texture mapping, and a self-learning based cleaning pipeline for processing noisy training datasets. Then, considering the impacts of the long-tail distribution and hard faces samples, a loss function named Balanced Curricular Loss is introduced. Together with a bag of tricks is briefly presented. Experimental results show that the proposed solution separately achieved 84.528% @ Mask and 88.355% @ MR-ALL in InsightFace ms1m Track, which ranks 3rd when the paper submitted.
Face Recognition based on scale invariant feature transform and Spatial Pyramid Representation

Tao Song,Ke Xiang,Xuan-Yin Wang

DOI: https://doi.org/10.1109/SMC.2014.6974579

2014-01-01

Abstract:For Face Recognition (FR) task, local feature based approaches have proven to be more robust to variations than the holistic approaches. As one of the state-of-the-art local descriptors with excellent performance for matching different images of an object or a scene, Scale Invariant Feature Transform (SIFT) has sparingly been used in FR, and whether it is a good descriptor for face images needs to be analyzed more. In this paper we propose a face representation approach based on SIFT and Spatial Pyramid Representation (SPR), to enhance the recognition performance of SIFT based method. Firstly it employs SIFT to extract discriminative local features and then constructs Spatial Pyramid to form a local-holistic representation of a face image. Finally Classifiers such as Nearest Neighbor (NN) and Support Vector Machine (SVM) could be performed on representation vectors of equal length. The comparative experimental results on ORL and Yale databases indicate that our approach achieves better performance than other SIFT based methods. In addition, it shows great robustness against environmental variations such as pose mismatches, imperfect face alignment, various facial expressions and accessory configuration variations, demonstrating a new alternative method for FR task.
Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

Lifang Zhou,Weisheng Li,Yuewei Du,Bangjun Lei,Shan Liang

DOI: https://doi.org/10.1016/j.jvcir.2019.102641

IF: 2.887

2019-01-01

Journal of Visual Communication and Image Representation

Abstract:Traditional face recognition method usually faces the challenge of varying lighting condition. In this paper, we propose an illumination-invariant local binary descriptor learning method for face recognition. Unlike local binary descriptor (LBP) and its variants, which usually utilize the rigid sign function for binarization despite of data distributions. We first determine a dynamic thresholds strategy including the information of illumination variation to extract nonlinear multi-layer contrast features. Specially, Exponential Discriminant Analysis (EDA) is designed to act as preprocessing which can contribute to improve the discriminative ability of the face image by enlarging the margin between different classes relative to the same class. To further improve the recognition performance, we combined our preliminary work, the adaptive fuzzy fusion framework, to integrate the recognition results for multi-scale features spaces. Extensive experiments conducted on four face databases validate the effectiveness of the proposed method for illumination face recognition. (C) 2019 Published by Elsevier Inc.
Face Recognition Based on Multi-Wavelet and Sparse Representation.

Lijian Zhou,Yukai Xu,Zhe-Ming Lu,Tingyuan Nie

2014-01-01

Abstract:The feature dimension and redundancy can reduce the face recognition speed and rate, the shading and light changing can heavily affect the face recognition effect. So the first key to face recognition is how to effectively extract face features because the face image contains a lot of redundant information. Multi-wavelet transform has symmetry, orthogonality, compact support and high vanishing moments simultaneously, which can present the face features better than scalar wavelet in each band. By analyzing all the multi-wavelet frequency band components, we can see that the low frequency component of the face image can provide the main feature of a face, and the high frequency compo- nents often contain some noises caused by the external interference. Therefore, the low frequency component is often adopted to form the face features. For solving the second problem, we choose the sparse representation recognition method , which has strong ro- bustness to shading and light changing problem. So this paper proposes a face recognition method, which combines multi-wavelet with sparse representation recognition. First, we extract the face features by multi-wavelet, then establish a fully redundant dictionary, and use the sparse representation recognition algorithm for face recognition at last. Based on the YALE, the AR and the FERET face databases, the experimental results show that our method can effectively recognize faces, reduce the dimension of features and has good robustness.
Robust 3D Face Recognition by Local Shape Difference Boosting

Yueming Wang,Jianzhuang Liu,Xiaoou Tang

DOI: https://doi.org/10.1109/tpami.2009.200

2008-01-01

Abstract:This paper proposes a new 3D face recognition approach, Collective Shape Difference Classifier (CSDC), to meet practical application requirements, i.e., high recognition performance, high computational efficiency, and easy implementation. We first present a fast posture alignment method which is self-dependent and avoids the registration between an input face against every face in the gallery. Then, a Signed Shape Difference Map (SSDM) is computed between two aligned 3D faces as a mediate representation for the shape comparison. Based on the SSDMs, three kinds of features are used to encode both the local similarity and the change characteristics between facial shapes. The most discriminative local features are selected optimally by boosting and trained as weak classifiers for assembling three collective strong classifiers, namely, CSDCs with respect to the three kinds of features. Different schemes are designed for verification and identification to pursue high performance in both recognition and computation. The experiments, carried out on FRGC v2 with the standard protocol, yield three verification rates all better than 97.9 percent with the FAR of 0.1 percent and rank-1 recognition rates above 98 percent. Each recognition against a gallery with 1,000 faces only takes about 3.6 seconds. These experimental results demonstrate that our algorithm is not only effective but also time efficient.
Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Lijian Zhou,Hui Wang,Wanquan Liu,Zhe-Ming Lu

DOI: https://doi.org/10.1007/s11042-018-6868-6

IF: 2.577

2018-01-01

Multimedia Tools and Applications

Abstract:In this paper, we propose a novel face feature extraction approach based on Local Binary Pattern (LBP) and Two Dimensional Locality Preserving Projections (2DLPP) to enhance the texture features and preserve the space structure properties of a face image. LBP is firstly used to remove the effect of illumination and noise, which would enhance the detailed texture characteristics of face images. Then 2DLPP is performed to extract some prominent features and decrease the image dimension with space structure information. The Nearest Neighborhood Classifier (NNC) is used to recognize a face image at the end. In addition, the rule for dimension selection is studied from the results of experiments about choosing an appropriate feature dimension by 2DLPP computation. The experimental results on the Yale, the extended Yale B and CMU PIE C09 benchmark datasets showed that the proposed face feature extraction and recognition method achieves a better performance in comparison with similar techniques, and the proposed dimension selection rule can give an appropriate feature dimension in 2DLPP.
Face Recognition Based on Curvelets and Local Binary Pattern Features Via Using Local Property Preservation

Lijian Zhou,Wanquan Liu,Zhe-Ming Lu,Tingyuan Nie

DOI: https://doi.org/10.1016/j.jss.2014.04.037

IF: 3.5

2014-01-01

Journal of Systems and Software

Abstract:In this paper, we propose a new feature extraction approach for face recognition based on Curvelet transform and local binary pattern operator. The motivation of this approach is based on two observations. One is that Curvelet transform is a new anisotropic multi-resolution analysis tool, which can effectively represent image edge discontinuities; the other is that local binary pattern operator is one of the best current texture descriptors for face images. As the curvelet features in different frequency bands represent different information of the original image, we extract such features using different methods for different frequency bands. Technically, the lowest frequency band component is processed using the local binary pattern method, and only the medium frequency band components are normalized. And then, we combine them to create a feature set, and use the local preservation projection to reduce its dimension. Finally, we classify the test samples using the nearest neighbor classifier in the reduced space. Extensive experiments on the Yale database, the extended Yale B database, the PIE pose 09 database, and the FRGC database illustrate the effectiveness of the proposed method.
Multi-scale Patch Based Representation Feature Learning for Low-Resolution Face Recognition

Guangwei Gao,Yi Yu,Meng Yang,Pu Huang,Qi Ge,Dong Yue

DOI: https://doi.org/10.1016/j.asoc.2020.106183

IF: 8.7

2020-01-01

Applied Soft Computing

Abstract:In practical video surveillance, the quality of facial regions of interest is usually affected by the large distances between the objects and surveillance cameras, which undoubtedly degrade the recognition performance. Existing methods usually consider the holistic representations, while neglecting the complementary information from different patch scales. To tackle this problem, this paper proposes a multi-scale patch based representation feature learning (MSPRFL) scheme for low-resolution face recognition problem. Specifically, the proposed MSPRFL approach first exploits multi-level information to learn more accurate resolution-robust representation features of each patch with the help of a training dataset. Then, we exploit these learned resolution-robust representation features to reduce the resolution discrepancy by integrating the recognition results from all patches. Finally, by considering the complementary discriminative ability from different patch scales, we try to fuse the multi-scale outputs by learning scale weights via an ensemble optimization model. We further verify the efficiency of the proposed MSPRFL on low-resolution face recognition by the comparison experiments on several commonly used face datasets.
Face recognition with multi-scale block local ternary patterns

Lian Zhu,Yan Zhang,Changyin Sun,Wankou Yang

DOI: https://doi.org/10.1007/978-3-642-36669-7_27

2013-01-01

Abstract:In this paper, we propose a novel approach to face recognition, called Multi-scale Block Local Ternary Patterns (MB-LTP), which considers both local and various scale texture information to represent face images. In MB-LTP, we compare average values of sub-regions and use a 3-valued codes method to get the MB-LTP value. The MB-LTP histograms are then extracted and concatenated into a single, spatially enhanced feature vector representing the face image in recognition. We use a nearest neighbor classifier in the computed feature space with Chi square as a dissimilarity measure. MB-LTP code presents several advantages: (1)It is more robust than LBP;(2)it is more discriminative and less sensitive to noise;(3)it encodes not only microstructures but also macrostructures of image patterns. Experiments on ORL and AR databases show that the proposed MB-LTP method significantly outperforms other LBP based face recognition algorithms.
A Multi-modal 2D + 3D Face Recognition Method with a Novel Local Feature Descriptor

Xu Dai,Shouyi Yin,Peng Ouyang,Leibo Liu,Shaojun Wei

DOI: https://doi.org/10.1109/WACV.2015.93

2015-01-01

Abstract:The research on depth map is becoming a focus of image understanding and computer vision. In this paper, depth map is introduced to enhance the performance of face recognition and a novel multi-modal 2D + 3D method is proposed. First of all, we propose a new local feature descriptor called Enhanced Local Mixed Derivative Pattern (ELMDP). Then, this feature descriptor is applied on the 2D intensity image and the depth map respectively. At last the two parts of extracted feature are combined together, multiplied by corresponding confidence weights. Experiments are conducted on 3 sub-databases of Curtin Faces database which contains variations in illumination, expression, pose and disguise. Our proposed method outmatches the other methods on recognition rate and the Receiver Operating Characteristic (ROC) curve is much gentler. All the results demonstrate that the proposed method is quite outstanding and robust.
Feature Space-Based Human Face Image Representation and Recognition

Yong Xu,Zizhu Fan,Qi Zhu

DOI: https://doi.org/10.1117/1.oe.51.1.017205

IF: 1.3

2012-01-01

Optical Engineering

Abstract:We propose a novel face recognition method that represents and classifies face images in the feature space. It first assumes that in the feature space the test sample can be well expressed by a linear combination of the training samples, and then it exploits the obtained linear combination to perform face recognition. We also present the foundation, rationale, and characteristics of, as well as the differences between, our method and conventional kernel methods. The analysis shows that our method is a representation-based kernel method and works in the feature space. This method might be able to outperform the representation-based methods that work in the original space. The experimental results show that our method partially possesses the properties of "sparseness" and is able to reduce greatly the effects of noise and occlusion in the test sample. (C) 2012 Society of Photo-Optical Instrumentation Engineers (SPIE). [DOI: 10.1117/1.OE.51.1.017205]
Face recognition via fast dense correspondence

Quan Zhou,Cheng Zhang,Wenbin Yu,Yawen Fan,Hu Zhu,Xiaofu Wu,Weihua Ou,Weiping Zhu,Longin Jan Latecki

DOI: https://doi.org/10.1007/s11042-017-4569-1

IF: 2.577

2017-03-11

Multimedia Tools and Applications

Abstract:Face recognition plays a significant role in computer vision. It is well know that facial images are complex stimuli signals that suffer from non-rigid deformations, including misalignment, orientation, pose changes, and variations of facial expression, etc. In order to address these variations, this paper introduces an improved sparse-representation based face recognition method, which constructs dense pixel correspondences between training and testing facial samples. Specifically, we first construct a deformable spatial pyramid graph model that simultaneously regularizes matching consistency at multiple spatial extents - ranging from an entire image, though coarse grid cells, to every single pixel. Secondly, a matching energy function is designed to perform face alignment based on dense pixel correspondence, which is very effective to address the issue of non-rigid deformations. Finally, a novel coarse-to-fine matching scheme is designed so that we are able to speed up the optimization of the matching energy function. After the training samples are aligned with respect to testing samples, an improved sparse representation model is employed to perform face recognition. The experimental results demonstrate the superiority of the proposed method over other methods on ORL, AR, and LFWCrop datasets. Especially, the proposed approach improves nearly 4.4 % in terms of recognition accuracy and runs nearly 10 times faster than previous sparse approximation methods.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
Face Recognition Based On Pose-Variant Image Synthesis And Multi-Level Multi-Feature Fusion

Congcong Li,Guangda Su,Yan Shang,Yingchun Li,Yan Xiang

DOI: https://doi.org/10.1007/978-3-540-75690-3_20

2007-01-01

Abstract:Pose variance remains a challenging problem for face recognition. In this paper, a scheme including image synthesis and recognition is proposed to improve the performance of automatic face recognition system. In the image synthesis part, a series of pose-variant images are produced based on. three images respectively with front, left-profile, right-profile poses, and are added into the gallery in order to overcome the pose inconsistence between probes and images in the database. In the recognition part, a multi-level fusion method based on Gabor-combined features and gray-intensity features (GCGIF) is presented. Both amplitude features and phase features extracted through Gabor filters are utilized. Fusion is introduced in both the face representation level and the confidence level. Experiment results show that the integrated scheme achieve superior recognition performance.
Face recognition using part-based dense sampling local features

Jiaqi Zhang,Yao Deng,Zhenhua Guo,Youbin Chen

DOI: https://doi.org/10.1016/j.neucom.2015.07.141

IF: 6

2016-04-01

Neurocomputing

Abstract:For years, researchers have made great efforts to find an appropriate face representation for face recognition. A fusion strategy of Local Binary Pattern (LBP) and Gabor filters yields great achievements. LBP is good at coding fine details of facial appearance and texture, whereas Gabor features can encode facial shape and appearance over a range of coarser scales. Despite the great performance, this fusion representation suffers from low effectiveness and resolution variance. In this paper, we propose a novel representation strategy of face images which is fast and robust to resolution variance. We apply dense sampling around each detected feature point, extract Local Difference Feature (LDF) for face representation, then utilize Principal Component Analysis (PCA)+Linear Discriminant Analysis (LDA) to reduce feature dimension and finally use cosine similarity evaluation for recognition. We have utilized our proposed face representation strategy on two databases, namely self-collected Second Generation ID Card of China and Driver׳s License (SGIDCDL) database and public Facial Recognition Technology (FERET) database. Our experimental results show that the proposed strategy has good performance on face recognition with fast speed.

computer science, artificial intelligence
PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition

Qiang Meng,Xiaqing Xu,Xiaobo Wang,Yang Qian,Yunxiao Qin,Zezheng Wang,Chenxu Zhao,Feng Zhou,Zhen Lei

DOI: https://doi.org/10.48550/arXiv.2107.11721

2021-07-25

Computer Vision and Pattern Recognition

Abstract:Despite the great success achieved by deep learning methods in face recognition, severe performance drops are observed for large pose variations in unconstrained environments (e.g., in cases of surveillance and photo-tagging). To address it, current methods either deploy pose-specific models or frontalize faces by additional modules. Still, they ignore the fact that identity information should be consistent across poses and are not realizing the data imbalance between frontal and profile face images during training. In this paper, we propose an efficient PoseFace framework which utilizes the facial landmarks to disentangle the pose-invariant features and exploits a pose-adaptive loss to handle the imbalance issue adaptively. Extensive experimental results on the benchmarks of Multi-PIE, CFP, CPLFW and IJB have demonstrated the superiority of our method over the state-of-the-arts.
Locally-Focused Face Representation for Sketch-to-Image Generation Using Noise-Induced Refinement

Muhammad Umer Ramzan,Ali Zia,Abdelwahed Khamis,yman Elgharabawy,Ahmad Liaqat,Usman Ali

2024-11-28

Abstract:This paper presents a novel deep-learning framework that significantly enhances the transformation of rudimentary face sketches into high-fidelity colour images. Employing a Convolutional Block Attention-based Auto-encoder Network (CA2N), our approach effectively captures and enhances critical facial features through a block attention mechanism within an encoder-decoder architecture. Subsequently, the framework utilises a noise-induced conditional Generative Adversarial Network (cGAN) process that allows the system to maintain high performance even on domains unseen during the training. These enhancements lead to considerable improvements in image realism and fidelity, with our model achieving superior performance metrics that outperform the best method by FID margin of 17, 23, and 38 on CelebAMask-HQ, CUHK, and CUFSF datasets; respectively. The model sets a new state-of-the-art in sketch-to-image generation, can generalize across sketch types, and offers a robust solution for applications such as criminal identification in law enforcement.

Computer Vision and Pattern Recognition
Face Recognition Method Based on Multi Features Description and Local Fusion Classification Decision

Fuji REN,Yanqiu LI,Min HU,Liangfeng XU

DOI: https://doi.org/10.3969/j.issn.1003-501X.2016.09.001

2016-01-01

Abstract:A face recognition method is proposed based on multi features description and local fusion decision. Firstly, we use Independent Component Analysis (ICA) to construct the global complementary subspace to roughly classify the test samples. Then the texture descriptor algorithms under three different definitions are used to construct local complementary subspace to obtain the posterior probability of sample which is difficult to classify by rough classification. Finally, we get the precise classification result of test sample on the local complementary subspace through setting grade scores based on the value of the posterior probability. The experimental results on ORL, Yale and FERET face database show that the proposed method better describes characteristics of the image and has lower time complexity and higher recognition rate. Compared with other methods, it also proves its effectiveness on the face recognition.
Two-Stage Multi-Scale Resolution-Adaptive Network for Low-Resolution Face Recognition

Haihan Wang,Shangfei Wang,Lin Fang

DOI: https://doi.org/10.1145/3503161.3548196

2022-01-01

Abstract:Low-resolution face recognition is challenging due to uncertain input resolutions and the lack of distinguishing details in low-resolution (LR) facial images. Resolution-invariant representations must be learned for optimal performance. Existing methods for this task mainly minimize the distance between the representations of the low-resolution (LR) and corresponding high-resolution (HR) image pairs in a common subspace. However, these works only focus on introducing various distance metrics at the final layer and between HR-LR image pairs. They do not fully utilize the intermediate layers or multi-resolution supervision, yielding only modest performance. In this paper, we propose a novel two-stage multi-scale resolution-adaptive network to learn more robust resolution-invariant representations. In the first stage, the structural patterns and the semantic patterns are distilled from HR images to provide sufficient supervision for LR images. A curriculum learning strategy facilitates the training of HR and LR image matching, smoothly decreasing the resolution of LR images. In the second stage, a multi-resolution contrastive loss is introduced on LR images to enforce intra-class clustering and inter-class separation of the LR representations. By introducing multi-scale supervision and multi-resolution LR representation clustering, our network can produce robust representations despite uncertain input sizes. Experimental results on eight benchmark datasets demonstrate the effectiveness of the proposed method. Code will be released at https://github.com/hhwang98/TMR.
Using the original and 'symmetrical face' training samples to perform representation based two-step face recognition

Xu Yong,Zhu Xingjie,Li Zhengming,Liu Guanghai,Lu Yuwu,Liu Hong

DOI: https://doi.org/10.1016/j.patcog.2012.11.003

IF: 8

2013-01-01

Pattern Recognition

Abstract:A limited number of available training samples have become one bottleneck of face recognition. In real-world applications, the face image might have various changes owing to varying illumination, facial expression and poses. However, non-sufficient training samples cannot comprehensively convey these possible changes, so it is hard to improve the accuracy of face recognition. In this paper, we propose to exploit the symmetry of the face to generate new samples and devise a representation based method to perform face recognition. The new training samples really reflect some possible appearance of the face. The devised representation based method simultaneously uses the original and new training samples to perform a two-step classification, which ultimately uses a small number of classes that are 'near' to the test sample to represent and classify it and has a similar advantage as the sparse representation method. This method also takes advantages of the score level fusion, which has proven to be very competent and usually performs better than the decision level and feature level fusion. The experimental results show that the proposed method outperforms state-of-the-art face recognition methods including the sparse representation classification (SRC), linear regression classification (LRC), collaborative representation (CR) and two-phase test sample sparse representation (TPTSSR). © 2012 Elsevier Ltd. All rights reserved.

Face recognition using a novel image representation scheme and multi-scale local features

Robust Face Recognition by Fusion Local Singular Value Feature and Deformable Model

Towards Mask-robust Face Recognition.

Face Recognition based on scale invariant feature transform and Spatial Pyramid Representation

Adaptive Illumination-Invariant Face Recognition Via Local Nonlinear Multi-Layer Contrast Feature.

Face Recognition Based on Multi-Wavelet and Sparse Representation.

Robust 3D Face Recognition by Local Shape Difference Boosting

Face Feature Extraction and Recognition Via Local Binary Pattern and Two-Dimensional Locality Preserving Projection

Face Recognition Based on Curvelets and Local Binary Pattern Features Via Using Local Property Preservation

Multi-scale Patch Based Representation Feature Learning for Low-Resolution Face Recognition

Face recognition with multi-scale block local ternary patterns

A Multi-modal 2D + 3D Face Recognition Method with a Novel Local Feature Descriptor

Feature Space-Based Human Face Image Representation and Recognition

Face recognition via fast dense correspondence

Face Recognition Based On Pose-Variant Image Synthesis And Multi-Level Multi-Feature Fusion

Face recognition using part-based dense sampling local features

PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition

Locally-Focused Face Representation for Sketch-to-Image Generation Using Noise-Induced Refinement

Face Recognition Method Based on Multi Features Description and Local Fusion Classification Decision

Two-Stage Multi-Scale Resolution-Adaptive Network for Low-Resolution Face Recognition

Using the original and 'symmetrical face' training samples to perform representation based two-step face recognition