Improved discriminate analysis for high-dimensional data and its application to face recognition

ZhuangXiao-Sheng,DaiDao-Qing

IF: 8

2007-01-01

Pattern Recognition

Abstract:Many pattern recognition applications involve the treatment of high-dimensional data and the small sample size problem. Principal component analysis (PCA) is a common used dimension reduction techn...

What problem does this paper attempt to address?

Discriminative analysis of direct linear discriminant analysis for face recognition

赵武锋,沈海斌,严晓浪

DOI: https://doi.org/10.3785/j.issn.1008-973X.2010.08.008

2010-01-01

Abstract:Direct linear discriminant analysis (DLDA) is claimed that it can take advantage of all the information, both within and outside of the within-class scatter matrix's null space. In order to analyze this claim's flaw in theory, the discriminative characteristics of DLDA for face recognition was studied. Since the optimal solution of DLDA is inside the range space of the between-class scatter matrix, a theoretical analysis was unfold via the following three aspects: the relationship between the within-class and between-class scatter matrix's range space, the relationship between the within-class scatter matrix's null space and the between-class scatter matrix's range space, the characteristics of DLDA under keeping all the discriminative vectors. The results show that: in undersampled cases DLDA nearly can not make use of the information inside the null space of the within-class scatter matrix, thus some discriminative information may be lost; DLDA is degenerated as PCA of the between-class scatter matrix with all nonzero principal components if it keeps the complete discriminative vectors found. The comparative results on the face database, ORL and YALE, indicate that DLDA is inferior to the other extensions of linear discriminant analysis in terms of recognition accuracy. Which is consistent with the theoretical analysis.
Spectral analysis for face recognition

Xiaofei He,Shuicheng Yan,Yuxiao Hu,Hong-Jiang Zhang

2003-01-01

Abstract:Different eigenspace-based approaches have been proposed for the recognition of faces, i.e. eigenface, fisherface and Laplacianface. For fisherfaces, the original image space is reduced to an n-c dimensional subspace in which the standard LDA is carried out, where n is the number of training samples and c is the number of classes. In this paper, we present a spectral analysis of fisherface which shows that the initial PCA dimensionality reduction might be insufficient. The noise might not be completely eliminated. This is due to the fact that fisherface only takes into account the discriminating structure while ignores geometrical structure. Based on the theoretical analysis, we propose a new method, called enhanced fisherface, which takes into account the discriminating structure as well as the intrinsic geometrical structure. Experimental results show that the proposed approach is effective in improving the performance of face recognition.
Discriminant Common Vectors in Principal Component Analysis Transformed Space for Face Recognition

唐亮,熊蓉,刘勇

2009-01-01

Abstract:In this paper, we first offer an efficient algorithm to perform DCV in principal component analysis (PCA) transformed space. In this way, we reduce the algorithm's complexity and improve the efficiency whilst preserving the whole discriminant information. Then, the new algorithm further facilitates us to subtly weight the facial components in PCA space according to corresponding eigenvalues, which is potential to enrich the representative information and thus improves DCV's recognition performance. The experiments conducted on ORL, YALE and AR face database demonstrate the effectiveness of our method.
Constrained Linear Discrimination Analysis and Face Recognition

LI Xiao-run,Guangzhou Zhao,ZHAO Liao-ying

2008-01-01

Abstract:A constrained linear discrimination analysis method was proposed for the feature extraction in the pattern recognition of problems with high dimension and small samples. Applying whitening process and Gram-Schimdt orthogonalization and orthogonal subspace projection, an optimal transformation matrix was designed to minimize the ratio of intra-class distance to inter-class distance while imposing the constraint that different class centers after transformation are along specifically directions that are orthogonal each other. For the small sample problem of face recognition, the whitening process was realized by singular value decomposition. The experimental results using the ORL and the UMIST face image database demonstrate that the effectiveness and performance of CLDA is approximate with some Fisher discrimination analysis such as direct Fisher discrimination analysis (DDA) and regularized Fisher discriminant analysis (R-LDA).
Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Lifang Zhou,Bin Fang,Weisheng Li,Lidou Wang

2013-01-01

Abstract:Global features-based methods and local features -based methods have been very successful in face recognition system, yet they can be combined together and jointly optimized so as to minimize the error of a nearest-neighbor classifier. We consider both descriptor for face images with Local Multiple Pattern, and discriminant learning techniques with Exponential Discriminant Analysis. A combination framework based on Local Multiple Pattern and Exponential Discriminant Analysis has been proposed in this paper. Firstly, our approach encodes the multi-scale face feature by Local Multiple Pattern, and then they have been extended to strengthen the discriminative ability by Exponential Discriminant Analysis; Secondly, we suggest to use the above feature on different layers independently so that a multiple classifier system can be attained. Using these techniques, we obtain the state-of-the-art performance on two public available databases. © 2013 IFSA.
Improved kernel direct Fisher discriminant analysis and face recognition

Xiao-run LI,Guang-zhou ZHAO,Liao-ying ZHAO

DOI: https://doi.org/10.3785/j.issn.1008-973X.2008.04.007

2008-01-01

Abstract:An improved kernel direct discriminant analysis(IKDDA) was proposed to compute the optimal discriminant vectors for the kernel-based Fisher discriminant analysis in singular cases.Based on the reproducing kernel theory,the kernel within-class and the kernel between-class scatter matrices were defined,then the Fisher discriminant criterion in the high-dimensional feature space was transformed to the kernel Fisher discriminant criterion.According to the isomorphic mapping theory and the singular value decomposition theorem,the maximum of the kernel Fisher discriminant criterion could be skillfully acquired by solving the minimum of its reciprocal in a small space,thus the final solution could be acquired not to take account of the null space and non-null space of the kernel within-class scatter matrices separately.Experimental results on the ORL and the UMIST face image database indicate that the proposed method can achieve lower error rate and quicker speed compared with other methods.
Improved Principal Component Analysis for Face Image Recognition

Jina De Zhang,Chen Rong Hang,Jin Bao Xu,Hang Chen

DOI: https://doi.org/10.4028/www.scientific.net/amm.380-384.3734

2013-01-01

Applied Mechanics and Materials

Abstract:Principal cmponent analysis is applied to face recognition problem to shorten image processing time in this paper. Based on the analysis of basic principal cmponent analysis algorithm, a new strategy which can improve algorithm efficiency by reducing the dimension of face images to be processed is introduced to face recognition problem, and the detailed computer implementation procedure is given. Numerical experiments have been performed to evaluate the efficiency of improved principal cmponent analysis algorithm for the problem of face recognition.
Rapid and brief communication: Diagonal principal component analysis for face recognition

Daoqiang Zhang,Zhi-Hua Zhou,Songcan Chen

DOI: https://doi.org/10.1016/j.patcog.2005.08.002

2006-01-01

Abstract:AbstractIn this paper, a novel subspace method called diagonal principal component analysis (DiaPCA) is proposed for face recognition. In contrast to standard PCA, DiaPCA directly seeks the optimal projective vectors from diagonal face images without image-to-vector transformation. While in contrast to 2DPCA, DiaPCA reserves the correlations between variations of rows and those of columns of images. Experiments show that DiaPCA is much more accurate than both PCA and 2DPCA. Furthermore, it is shown that the accuracy can be further improved by combining DiaPCA with 2DPCA.
By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

Guang Dai,Yuntao Qian

DOI: https://doi.org/10.1109/ICSMC.2004.1400650

2004-01-01

Abstract:Linear discriminant analysis (LDA) is an effective feature extraction technique for classification. A new LDA-based algorithm, i.e., direct normalized generalized Foley-Sammon transform (DN-GFST) method in high dimensional spaces, is presented in this paper. It not only overcomes the limitation of traditional LDA that they overemphasize the larger distance between classes and cause large overlaps of neighboring classes, but also has the best separable ability in global sense. Lastly, our method is applied to facial image recognition, and the experimental results show that the performance of the present method is superior to those of the existing methods in terms of the classification error rate.
An MPCA/LDA Based Dimensionality Reduction Algorithm for Face Recognition

Jun Huang,Kehua Su,Jamal El-Den,Tao Hu,Junlong Li

DOI: https://doi.org/10.1155/2014/393265

IF: 1.43

2014-01-01

Mathematical Problems in Engineering

Abstract:We proposed a face recognition algorithm based on both the multilinear principal component analysis (MPCA) and linear discriminant analysis (LDA). Compared with current traditional existing face recognition methods, our approach treats face images as multidimensional tensor in order to find the optimal tensor subspace for accomplishing dimension reduction. The LDA is used to project samples to a new discriminant feature space, while the K nearest neighbor (KNN) is adopted for sample set classification. The results of our study and the developed algorithm are validated with face databases ORL, FERET, and YALE and compared with PCA, MPCA, and PCA + LDA methods, which demonstrates an improvement in face recognition accuracy.

engineering, multidisciplinary,mathematics, interdisciplinary applications
Tied Factors Analysis for High-Dimensional Image Feature Extraction and Recognition Application

Haibin Liao,Youbin Chen,Wenhua Dai,Ruolin Ruan

DOI: https://doi.org/10.1007/s10044-016-0572-9

2016-01-01

Abstract:Feature extraction from images, which are typical of high dimensionality, is crucial to the recognition performance. To explore the discriminative information while depressing the intra-class variations due to variable illumination and view conditions, we propose a factor analysis framework for separate “content” from “style,” identifying a familiar face seen under unfamiliar viewing conditions, classifying familiar poses presented in an unfamiliar face, estimating age across unfamiliar faces. The framework applies efficient algorithms derived from objective factor separating functions and space mapping functions, which can produce sufficiently expressive representations of feature extraction and dimensionality reduction. We report promising results on three different tasks in the high-dimensional image perceptual domains: face identification with two benchmark face databases, facial pose classification with a benchmark facial pose database, extrapolation of age to unseen facial image. Experimental results show that our approach produced higher classification performance when compared to classical LDA, WLDA, LPP, MFA, and DLA algorithms.
Discuss and Research of Face Recognition Based on PCA Algorithm

孙强,叶玉堂,邢同举,吴建平,周孟特,王智芳

DOI: https://doi.org/10.3969/j.issn.1674-6236.2011.20.037

2011-01-01

Abstract:Face recognition is an especially important subject in the area of biometrical recognition technology and artificial intelligence. In the paper, the application of Principal Component Analysis in the face recognition is discussed. PCA is based on the statistics, and can play an role of reducing the dimension and dependent of the face image database data. The feature subspace of face can be obtained after transformed the image face database to a new coordinate system through Kauhunen- Loeve （K-L） transformation. Then project the test image to feature subspace; At last, the projection result is classified using the 2-norm distance classifier to achieve the goal of recognition. The test of face image database with PCA is presented.
Diagonal principal component analysis for face recognition

Daoqiang Zhang,Zhi-Hua Zhou,Songcan Chen

DOI: https://doi.org/10.1016/j.patcog.2005.08.002

IF: 8

2006-01-01

Pattern Recognition

Abstract:In this paper, a novel subspace method called diagonal principal component analysis (DiaPCA) is proposed for face recognition. In contrast to standard PCA, DiaPCA directly seeks the optimal projective vectors from diagonal face images without image-to-vector transformation. While in contrast to 2DPCA, DiaPCA reserves the correlations between variations of rows and those of columns of images. Experiments show that DiaPCA is much more accurate than both PCA and 2DPCA. Furthermore, it is shown that the accuracy can be further improved by combining DiaPCA with 2DPCA.
Research on Two Dimensional Nonparametric Discriminant Analysis for Face Recognition

张旭,曹健,刘玉树

DOI: https://doi.org/10.15918/j.tbit1001-0645.2010.04.024

2010-01-01

Abstract:A novel method for face recognition based on two dimensional nonparametric discriminant analysis is proposed.Traditional LDA-based methods suffer in disadvantages such as small sample size problem(SSS),a dimensionality,as well as a fundamental limitation resulting from the parametric nature of scatter matrices,which are based on the Gaussian distribution assumption.To address the problem,a new two dimensional nonparametric discriminant analysis is proposed,a new formulation of scatter matrices is given.Experimental results indicate the robustness and accuracy of the proposed method.
Discriminative Principal Component Analysis: A REVERSE THINKING

Hanli Qiao

DOI: https://doi.org/10.48550/arXiv.1903.04963

2019-03-12

Abstract:In this paper, we propose a novel approach named by Discriminative Principal Component Analysis which is abbreviated as Discriminative PCA in order to enhance separability of PCA by Linear Discriminant Analysis (LDA). The proposed method performs feature extraction by determining a linear projection that captures the most scattered discriminative information. The most innovation of Discriminative PCA is performing PCA on discriminative matrix rather than original sample matrix. For calculating the required discriminative matrix under low complexity, we exploit LDA on a converted matrix to obtain within-class matrix and between-class matrix thereof. During the computation process, we utilise direct linear discriminant analysis (DLDA) to solve the encountered SSS problem. For evaluating the performances of Discriminative PCA in face recognition, we analytically compare it with DLAD and PCA on four well known facial databases, they are PIE, FERET, YALE and ORL respectively. Results in accuracy and running time obtained by nearest neighbour classifier are compared when different number of training images per person used. Not only the superiority and outstanding performance of Discriminative PCA showed in recognition rate, but also the comparable results of running time.

Computer Vision and Pattern Recognition
Two-Dimensional fisher discriminant analysis and its application to face recognition

Zhizheng Liang,Pengfei Shi,David Zhang

DOI: https://doi.org/10.1007/11612032_14

2006-01-01

Abstract:Image matrices are often transformed into vectors prior to feature extraction, which results in the curse of dimensionality when the dimensions of matrices are huge. In order to effectively deal with this problem, a new technique for two-dimensional(2D) Fisher discriminant analysis is developed in this paper. In the proposed algorithm, the Fisher criterion function is directly constructed in terms of image matrices. Then we utilize the Fisher criterion and statistical correlation between features to construct an objective function. We theoretically analyze that the proposed algorithm is equivalent to uncorrelated two-dimensional discriminant analysis in some condition. To verify the effectiveness of the proposed algorithm, experiments on ORL face database are made. Experimental results show that the performance of the proposed algorithm is superior to those of some previous methods in feature extraction. Moreover, extraction of image features using the proposed algorithm needs less time than that of classical linear discriminant analysis.
Classification Probability Preserving Discriminant Analysis and Its Application to Face Recognition

Zhang-Jing YANG,Chuan-Cai LIU,Pu HUANG,Jun ZHU

DOI: https://doi.org/10.3969/j.issn.1003-6059.2014.01.009

2014-01-01

Abstract:To solve the problems in feature extraction algorithms, an algorithm based on linear discriminant analysis ( LDA) , called classification probability preserving discriminant analysis ( CPPDA) , is proposed for face recognition. Firstly, the classification probability of each sample is computed by CPPDA, and both the between-class scatter matrix and the within-class scatter matrix are redefined by the classification probability. Secondly, through maximizing the between-class scatter and minimizing the within-class scatter simultaneously, an optimal projection matrix can be preserved in the low-dimensional feature space, such as the distribution information contained in the original data. Finally, the experimental results on the ORL,Yale and FERET face databases demonstrate the superiority of the proposed algorithm compared with other algorithms.
An efficient data dimensionality reduction scheme based on SIFT for face recognition

Xianzhong Long,Hongtao Lu,Yong Peng,Lei Huang

DOI: https://doi.org/10.12733/jcisP0212

2013-01-01

Journal of Computational Information Systems

Abstract:In order to accelerate data processing and improve classification accuracy, some classic dimension reduction techniques have been proposed in the past few decades, such as Principal Component Analysis (PCA), Linear Discriminant Analysis (LDA), Locally Preserving Projections (LPP), etc. In this paper, we put forward an efficient data dimensionality reduction scheme based on Scale Invariant Feature Transform (SIFT). Specifically, SIFT features of all images are first extracted, and then a dictionary is constructed by using k-means clustering algorithm, each image is finally represented according to their SIFT features and the obtained dictionary. A series of experimental results are carried out over two benchmark face databases to demonstrate the efficacy of our proposed scheme. © 2013 Binary Information Press.
Optimal Dimensionality Discriminant Analysis and Its Application to Image Recognition

Feiping Nie,Shiming Xiang,Yangqiu Song,Changshui Zhang

DOI: https://doi.org/10.1109/cvpr.2007.383411

2007-01-01

Abstract:Dimensionality reduction is an important issue when facing high-dimensional data. For supervised dimensionality reduction, linear discriminant analysis (LDA) is one of the most popular methods and has been successfully applied in many classification problems. However, there are several drawbacks in LDA. First, it suffers from the singularity problem, which makes it hard to preform. Second, LDA has the distribution assumption which may make it fail in applications where the distribution is more complex than Gaussian. Third, LDA can not determine the optimal dimensionality for discriminant analysis, which is an important issue but has often been neglected previously. In this paper, we propose a new algorithm and endeavor to solve all these three problems. Furthermore, we present that our method can be extended to the two-dimensional case, in which the optimal dimensionalities of the two projection matrices can be determined simultaneously. Experimental results show that our methods are effective and demonstrate much higher performance in comparison to LDA.
Human Face Recognition Based on Two Dimensional Nonparametric Discriminant Analysis

张旭,曹健,刘玉树

2009-01-01

Abstract:A novel method for Human face recognition based on two dimensional nonparametric discriminant analysis is proposed.Traditional LDA-based methods suffer from some disadvan-tages such as small sample size problem(SSS),course of a dimensionality,as well as a fundamental limitation resulting from the parametric nature of scatter matrices,based on the Gaussian distribution assumption.To address the problem,a new two dimensional nonparametric discriminant analysis is proposed and a new formulation of scatter matrices is given.Experimental results indicate the robustness and accuracy of the proposed method.

Improved discriminate analysis for high-dimensional data and its application to face recognition

Discriminative analysis of direct linear discriminant analysis for face recognition

Spectral analysis for face recognition

Discriminant Common Vectors in Principal Component Analysis Transformed Space for Face Recognition

Constrained Linear Discrimination Analysis and Face Recognition

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Improved kernel direct Fisher discriminant analysis and face recognition

Improved Principal Component Analysis for Face Image Recognition

Rapid and brief communication: Diagonal principal component analysis for face recognition

By Normalizing To Improve Generalized Foley-Sammon Transform In High-Dimensional Spaces-----With Application To Face Recognition

An MPCA/LDA Based Dimensionality Reduction Algorithm for Face Recognition

Tied Factors Analysis for High-Dimensional Image Feature Extraction and Recognition Application

Discuss and Research of Face Recognition Based on PCA Algorithm

Diagonal principal component analysis for face recognition

Research on Two Dimensional Nonparametric Discriminant Analysis for Face Recognition

Discriminative Principal Component Analysis: A REVERSE THINKING

Two-Dimensional fisher discriminant analysis and its application to face recognition

Classification Probability Preserving Discriminant Analysis and Its Application to Face Recognition

An efficient data dimensionality reduction scheme based on SIFT for face recognition

Optimal Dimensionality Discriminant Analysis and Its Application to Image Recognition

Human Face Recognition Based on Two Dimensional Nonparametric Discriminant Analysis