Face recognition using a kernel fractional-step discriminant analysis algorithm

DaiGuang,YeungDit-Yan,QianYun-Tao

IF: 8

2007-01-01

Pattern Recognition

Abstract:Feature extraction is among the most important problems in face recognition systems. In this paper, we propose an enhanced kernel discriminant analysis (KDA) algorithm called kernel fractional-step...

What problem does this paper attempt to address?

Face recognition using a kernel fractional-step discriminant analysis algorithm

Guang Dai,Dit-Yan Yeung,Yun-Tao Qian

DOI: https://doi.org/10.1016/j.patcog.2006.06.030

IF: 8

2007-01-01

Pattern Recognition

Abstract:Feature extraction is among the most important problems in face recognition systems. In this paper, we propose an enhanced kernel discriminant analysis (KDA) algorithm called kernel fractional-step discriminant analysis (KFDA) for nonlinear feature extraction and dimensionality reduction. Not only can this new algorithm, like other kernel methods, deal with nonlinearity required for many face recognition tasks, it can also outperform traditional KDA algorithms in resisting the adverse effects due to outlier classes. Moreover, to further strengthen the overall performance of KDA algorithms for face recognition, we propose two new kernel functions: cosine fractional-power polynomial kernel and non-normal Gaussian RBF kernel. We perform extensive comparative studies based on the YaleB and FERET face databases. Experimental results show that our KFDA algorithm outperforms traditional kernel principal component analysis (KPCA) and KDA algorithms. Moreover, further improvement can be obtained when the two new kernel functions are used.
A Kernel Fractional-Step Nonlinear Discriminant Analysis for Pattern Recognition

G Dai,YT Qian,S Jia

DOI: https://doi.org/10.1109/icpr.2004.1334246

2004-01-01

Abstract:Feature extraction is one of the most significant and fundamental problems in pattern recognition (PR). This paper introduces a novel kernel fractional-step nonlinear discriminant analysis (KF-NDA) for feature extraction in PR. It not only overcomes the limitation of failing for a nonlinear problem in the direct fractional-step linear discriminant analysis (DF-LDA), but also improves the generalization ability of traditional kernel nonlinear discriminant analysis (K-NDA). It is then applied to an experiment on face recognition, and the results demonstrate that this method is more effective than the existing methods.
Modified Kernel-Based Nonlinear Feature Extraction [face Recognition Example]

Guang Dai,Yuntao Qian,Sen Jia

DOI: https://doi.org/10.1109/icassp.2004.1327212

2004-01-01

Abstract:Feature extraction techniques are widely used in many applications to pre-process data in order to reduce the complexity of subsequent processes. A group of kernel-based Fisher discriminant analysis (KFDA) algorithms has attracted much attention due to their high performance. In this paper, the inherent limitations of those KFDA algorithms have been discussed and a novel algorithm is proposed to effectively overcome those limitations. Experimental results on face recognition suggest that this proposed algorithm is superior to the existing methods in terms of correct classification rate.
MODIFIED KERNEL-BASED NONLINEAR FEATURE EXTRACTION

Guang Dai,Yuntao Qian

2004-01-01

Abstract:Feature extraction techniques are widely used in many applications to pro-process data in order to reduce the complexity of subsequent processes. A group of kernel-based Fisher discrminant analysis (KFDA) algorithms has attracted much attention due to their high performance. In this paper, the inherent limitations of those KFDA algorithms have been discussed and the novel algorithm will be proposed to effectively overcome those limitations. Experimental results on face recognition suggest that this proposed algorithm is superior to the existing methods in terms of correct classification rate. Keywords: Feature extraction, kernel Fisher discriminant analysis, face recognition.
Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Guang Dai,Yuntao Qian

DOI: https://doi.org/10.1109/ICIP.2004.1421660

2004-01-01

Abstract:Linear discriminant analysis (LDA) is a very effective tool used for dimensionality reduction and feature extraction in pattern recognition. However, the LDA is inadequate to describe complex and nonlinear patterns. To solve this problem, kernel nonlinear discriminant analysis (K-NDA) has been proposed. Although successful in many cases, classic K-NDA also suffers from the small sample size problem (SSSP) and loses some significant discriminatory information as same as classic LDA. In this paper. a novel K-NDA, i.e., the kernel generalized nonlinear discriminant analysis (KG-NDA) algorithm is introduced to effectively overcome these problems, and it also views the optimal discriminant vectors as a global transform in the feature space to some extent. It not only deals with the nonlinear problem, but also effectively solves the SSSP. The KG-NDA is applied to the experiments oil face recognition, and the results tested oil two popular databases demonstrate that this method is very effective.
Kernel optimization-based discriminant analysis for face recognition

Jun-Bao Li,Jeng-Shyang Pan,Zhe-Ming Lu

DOI: https://doi.org/10.1007/s00521-009-0282-y

2009-01-01

Neural Computing and Applications

Abstract:The selection of kernel function and its parameter influences the performance of kernel learning machine. The difference geometry structure of the empirical feature space is achieved under the different kernel and its parameters. The traditional changing only the kernel parameters method will not change the data distribution in the empirical feature space, which is not feasible to improve the performance of kernel learning. This paper applies kernel optimization to enhance the performance of kernel discriminant analysis and proposes a so-called Kernel Optimization-based Discriminant Analysis (KODA) for face recognition. The procedure of KODA consisted of two steps: optimizing kernel and projecting. KODA automatically adjusts the parameters of kernel according to the input samples and performance on feature extraction is improved for face recognition. Simulations on Yale and ORL face databases are demonstrated the feasibility of enhancing KDA with kernel optimization.
An Efficient Reformative Kernel Discriminant Analysis for Face Recognition

Jun-Bao Li,Jeng-Shyang Pan,Zhe-Ming Lu

DOI: https://doi.org/10.1109/ROBIO.2006.340211

2006-01-01

Abstract:An efficient reformative kernel discriminant analysis, namely enhanced kernel discriminant analysis (EKDA), is proposed in this paper. In the proposed algorithm, a novel criterion, i.e., maximizing the class separability both in the feature space and in the projection subspace, is presented to enhance the discriminant power of KDA. EKDA is more adaptive to the input data under the novel criterion compared with KDA, which enhances the performance of EKDA. Experiments conducted on the Yale and ORL face databases give the higher recognition performance compared with KDA.
Kernel-based optimized feature vectors selection and discriminant analysis for face recognition

Qingshan Liu,Rui Huang,Hanqing Lu,Songde Ma

DOI: https://doi.org/10.1109/ICPR.2002.1048314

2002-01-01

Abstract:In practice, face image data distribution is very complex because of pose, illumination and facial expression variation, so it is inadequate to describe it just by Fisherface or Fisher linear discriminant analysis (FLDA). In the paper a method is presented for face recognition using kernel-based optimized feature vectors selection and discriminant analysis. The kernel trick is used to select an optimized subset from the data and form a subspace into the feature space that can capture the structure of the entire data into the feature space according to geometric consideration. Then all the data are projected into this subspace and FLDA is performed in this subspace to extract nonlinear discriminant features of the data for face recognition. Another similar analysis method is kernel-based Fisher discriminant analysis (KFDA), which transforms all the data into the feature space and FLDA is performed in the feature space. The proposed method is compared with Fisherface and KFDA on two benchmarks, and experimental results demonstrate that it outperforms Fisherface and can give the same recognition accuracy as KFDA, but its computational complexity is reduced against KFDA.
Face Recognition Using Novel LDA-Based Algorithms.

G Dai,YT Qian

2004-01-01

Abstract:Facial feature extraction with enhanced discriminatory power plays an important role in face recognition (FR) applications. Linear discriminant analysis (LDA) is a powerful tool used for dimensionality reduction and feature extraction in FR tasks. However, the classification performance of traditional LDA is often degraded, due to two factors: 1) their classification accuracies suffer from the small sample size problem (SSSP), which widely exists in FR; 2) their Fisher discriminant criteria are not directly related to the classification ability. Recently, so-called direct fractional-step LDA (DF-LDA) algorithm has been proposed to solve this problem. In this paper, the limitations of DF-LDA are discussed and a novel DF-LDA has been proposed to solve those problems. The novel DF-LDA has been tested, in terms of classification accuracy, on two face databases. Results reveal that the proposed method outperforms the existing methods, including: the Eigenfaces, Fisherfaces, D-LDA, previous DF-LDA, and EFM methods.
Face Recognition Using Gabor-based Complete Kernel Fisher Discriminant Analysis with Fractional Power Polynomial Models

Jun-Bao Li,Jeng-Shyang Pan,Zhe-Ming Lu

DOI: https://doi.org/10.1007/s00521-009-0272-0

2009-01-01

Neural Computing and Applications

Abstract:This paper presents a novel face recognition method by integrating the Gabor wavelet representation of face images and the enhanced powerful discriminator, complete Kernel Fisher Discriminant (CKFD) with fractional power polynomial (FPP) models. The novelty of this paper comes from (1) Gabor wavelet, is employed to extract desirable facial features characterized by spatial frequency, spatial locality and orientation selectivity to cope with the variations in illumination and facial expressions, which improves the recognition performance; (2) a recently proposed powerful discriminator, namely CKFD, which enhances its discriminating ability using two kinds of discriminant information (i.e., regular and irregular information), is employed to classify the Gabor features; (3) the FPP models, are employed to CKFD analysis to enhance the discriminating ability. Comparing with existing principal component analysis, linear discriminant analysis, kernel principal component analysis, KFD and CKFD methods, the proposed method gives the superior results with the ORL, Yale and UMIST face databases.
Kernel-based Nonlinear Discriminant Analysis for Face Recognition

Liu QingShan,Huang Rui,Lu HanQing,Ma SongDe

DOI: https://doi.org/10.1007/bf02945468

2003-01-01

Abstract:Linear subspace analysis methods have been successfully applied to extract features for face recognition. But they are inadequate to represent the complex and nonlinear variations of real face images, such as illumination, facial expression and pose variations, because of their linear properties. In this paper, a nonlinear subspace analysis method, Kernel-based Nonlinear Discriminant Analysis (KNDA), is presented for face recognition, which combines the nonlinear kernel trick with the linear subspace analysis method -- Fisher Linear Discriminant Analysis (FLDA). First, the kernel trick is used to project the input data into an implicit feature space, then FLDA is performed in this feature space. Thus nonlinear discriminant features of the input data are yielded. In addition, in order to reduce the computational complexity, a geometry-based feature vectors selection scheme is adopted. Another similar nonlinear subspace analysis is Kernel-based Principal Component Analysis (KPCA), which combines the kernel trick with linear Principal Component Analysis (PCA). Experiments are performed with the polynomial kernel, and KNDA is compared with KPCA and FLDA. Extensive experimental results show that KNDA can give a higher recognition rate than KPCA and FLDA.
Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Lifang Zhou,Bin Fang,Weisheng Li,Lidou Wang

2013-01-01

Abstract:Global features-based methods and local features -based methods have been very successful in face recognition system, yet they can be combined together and jointly optimized so as to minimize the error of a nearest-neighbor classifier. We consider both descriptor for face images with Local Multiple Pattern, and discriminant learning techniques with Exponential Discriminant Analysis. A combination framework based on Local Multiple Pattern and Exponential Discriminant Analysis has been proposed in this paper. Firstly, our approach encodes the multi-scale face feature by Local Multiple Pattern, and then they have been extended to strengthen the discriminative ability by Exponential Discriminant Analysis; Secondly, we suggest to use the above feature on different layers independently so that a multiple classifier system can be attained. Using these techniques, we obtain the state-of-the-art performance on two public available databases. © 2013 IFSA.
A practical application of kernel-based fuzzy discriminant analysis

Jian-qiang Gao,Li-ya Fan,Li Li,Li-zhong Xu

DOI: https://doi.org/10.2478/amcs-2013-0066

2013-01-01

Abstract:AbstractAbstractA novel method for feature extraction and recognition called Kernel Fuzzy Discriminant Analysis KFDA is proposed in this paper to deal with recognition problems, e.g., for images. The KFDA method is obtained by combining the advantages of fuzzy methods and a kernel trick. Based on the orthogonal-triangular decomposition of a matrix and Singular Value Decomposition SVD, two different variants, KFDA/QR and KFDA/SVD, of KFDA are obtained. In the proposed method, the membership degree is incorporated into the definition of between-class and within-class scatter matrices to get fuzzy between-class and within-class scatter matrices. The membership degree is obtained by combining the measures of features of samples data. In addition, the effects of employing different measures is investigated from a pure mathematical point of view, and the t-test statistical method is used for comparing the robustness of the learning algorithm. Experimental results on ORL and FERET face databases show that KFDA/QR and KFDA/SVD are more effective and feasible than Fuzzy Discriminant Analysis FDA and Kernel Discriminant Analysis KDA in terms of the mean correct recognition rate.
Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Jun-Bao Li,Jeng-Shyang Pan,Zhe-Ming Lu,Bin-Yih Liao

DOI: https://doi.org/10.1109/icia.2006.305931

2006-01-01

Abstract:Subspace analysis is an effective technique for feature extraction, which aims at finding a low-dimensional space of high-dimensional data. In this paper, a novel subspace analysis method based on Data-Dependent Kernel Discriminant Analysis (DDKDA) is proposed for dimension reduction. The procedure of DDKDA contains two stages: one is to find the optimal combination coefficients by solving a constrained optimization function which transformed to an eigenvalue problem; other is to implement KDA under the optimal data-dependent kernel with Fisher criterion. DDKDA is more adaptive to the input data than KDA owing to the optimization of projection from input space to feature space with the data-dependent kernel, which enhances the performance of KDA. Experiments on the ORL and Yale face databases demonstrate the good performance of the proposed algorithm.
Improved kernel direct Fisher discriminant analysis and face recognition

Xiao-run LI,Guang-zhou ZHAO,Liao-ying ZHAO

DOI: https://doi.org/10.3785/j.issn.1008-973X.2008.04.007

2008-01-01

Abstract:An improved kernel direct discriminant analysis(IKDDA) was proposed to compute the optimal discriminant vectors for the kernel-based Fisher discriminant analysis in singular cases.Based on the reproducing kernel theory,the kernel within-class and the kernel between-class scatter matrices were defined,then the Fisher discriminant criterion in the high-dimensional feature space was transformed to the kernel Fisher discriminant criterion.According to the isomorphic mapping theory and the singular value decomposition theorem,the maximum of the kernel Fisher discriminant criterion could be skillfully acquired by solving the minimum of its reciprocal in a small space,thus the final solution could be acquired not to take account of the null space and non-null space of the kernel within-class scatter matrices separately.Experimental results on the ORL and the UMIST face image database indicate that the proposed method can achieve lower error rate and quicker speed compared with other methods.
A New Face Recognition Method Based on Kernel Fisher Discriminant Analysis

孔锐,张国宣,施泽生,郭立

DOI: https://doi.org/10.3969/j.issn.1007-0249.2003.05.013

2003-01-01

Abstract:A new face recognition method is proposed. In this method, Kernel Fisher Discriminant Analysis (KFDA) is combined with Linear Support Vector Machine (SVM). KFDA is a new non-linear technique for extracting features. KFDA-based face recognition method is tested and compared with PCA, FDA and ICA-based face recognition methods using the same publicly available ATT database. Experiment results indicate that the performance of KFDA-based face recognition method is superior to the others.
Face Recognition Using Kernel Based Fisher Discriminant Analysis

QS Liu,R Huang,HQ Lu,SD Ma

DOI: https://doi.org/10.1109/afgr.2002.1004157

2002-01-01

Abstract:Fisher Linear Discriminant Analysis (FLDA) has been successfully applied to face recognition, which is based on a linear projection from the image space to a low dimensional space by maximizing the between-class scatter and minimizing the within-class scatter. However, face image data distribution in practice is highly complex because of illumination, facial expression and pose variations. We present the use of Kernel based Fisher Discriminant Analysis for face recognition. The kernel trick is used firstly to project the input data into an implicit space called feature space by nonlinear kernel mapping, then Fisher Linear Discriminant Analysis is adopted to this feature space, thus a nonlinear discriminant can be yielded in the input data. Another similar Kernel-based method is Kernel PCA, in which PCA is used in the feature space. The experiments are performed with the polynomial kernel, and this method is compared with Kernel PCA and FLDA. Extensive experimental results show that the correct recognition rate of this method is higher than that of Kernel PCA and FLDA.
Kernel Inverse Fisher Discriminant Analysis for Face Recognition

Zhongxi Sun,Jun Li,Changyin Sun

DOI: https://doi.org/10.1016/j.neucom.2012.12.075

IF: 6

2014-01-01

Neurocomputing

Abstract:In this paper, we present a new nonlinear feature extraction method for face recognition. The proposed method incorporates the kernel trick with inverse Fisher discriminant analysis and develops a two-phase kernel inverse Fisher discriminant analysis criterion – KPCA plus IFDA. In the proposed method, we first apply the nonlinear kernel trick to map the original face samples into an implicit feature space and then perform inverse Fisher discriminant analysis in the feature space to produce nonlinear discriminating features. In implementation, kernel IFDA seeks nonlinear discriminating features by minimizing the inverse Fisher discriminant quotient and overcome the singularity problem by projective transformation of scatter matrices. Experimental results on ORL, FERET and AR face databases demonstrate the effectiveness of the proposed method.
Kernel discriminant analysis based on support vectors

ZHANG Bao-Chang,CHEN Xi-Lin,SHAN Shi-Guang,Wen Gao

2006-01-01

Jisuanji Xuebao/Chinese Journal of Computers

Abstract:Discriminant analysis is one of crucial issues for the statistic-based face recognition methods. This paper proposes a novel Support Vectors based Kernel Fisher Discriminant analysis method (SV-KFD) for face recognition, which has combined the idea of the Support Vector Machine (SVM) and kernel Fisher analysis. The authors first discuss the relationship between SVM and kernel Fisher analysis. Based on the intrinsic nullspace property of the SVM proven by the authors, which shows that the normal vector of the SVM decision plane is of the nullspace property in terms of the support vectors-based within-class scatter matrix, a support vectors-based method is presented to construct the Kernelized Decision Boundary Feature Matrix (KDBFM) by using the SVM normal vectors. Furthermore the difference vector of the mean support vectors is combined to construct the Extended Kernelized Decision Boundary Feature Matrix (Ex-KDBFM). Finally, the nullspace Kernel Fisher method is exploited to seek the projection space, which is used to extract the discriminant features from the original face images. In addition, the proposed discriminant method includes two steps, and the tedious singularity problem can be avoided. The proposed method is applied on face recognition, and the experimental results on the FERET and CAS-PEAL-R1 databases show that it performs much better than the traditional kernel discriminant analysis methods in terms of the recognition rate.
Optimal Discriminant Analysis Based on Kernel Extension of Graph Embedding and Face Recognition

LU Gui-Fu,LIN Zhong,JIN Zhong

DOI: https://doi.org/10.3724/sp.j.1001.2011.03843

2011-01-01

Journal of Software

Abstract:By making use of compressive mapping and isomorphic mapping in the kernel extension of graph embedding, this paper proves that the essence of kernel extension of graph embedding (KGE) is KPCA (kernel principal component analysis) plus all kinds of linear dimension reduction approaches interpreted in a linear extension of graph embedding (LGE).Based on the theory framework, a combined framework, which takes advantage of the discriminant feature in both null and non-null spaces, is developed.Furthermore, every kernel dimensionality reduction algorithm has its own corresponding combined algorithm.The experimental results from ORL, Yale, FERET and PIE face databases show that the proposed methods are better than the original methods in terms of recognition rate.

Face recognition using a kernel fractional-step discriminant analysis algorithm

Face recognition using a kernel fractional-step discriminant analysis algorithm

A Kernel Fractional-Step Nonlinear Discriminant Analysis for Pattern Recognition

Modified Kernel-Based Nonlinear Feature Extraction [face Recognition Example]

MODIFIED KERNEL-BASED NONLINEAR FEATURE EXTRACTION

Kernel Generalized Nonlinear Discriminant Analysis Algorithm For Pattern Recognition

Kernel optimization-based discriminant analysis for face recognition

An Efficient Reformative Kernel Discriminant Analysis for Face Recognition

Kernel-based optimized feature vectors selection and discriminant analysis for face recognition

Face Recognition Using Novel LDA-Based Algorithms.

Face Recognition Using Gabor-based Complete Kernel Fisher Discriminant Analysis with Fractional Power Polynomial Models

Kernel-based Nonlinear Discriminant Analysis for Face Recognition

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

A practical application of kernel-based fuzzy discriminant analysis

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Improved kernel direct Fisher discriminant analysis and face recognition

A New Face Recognition Method Based on Kernel Fisher Discriminant Analysis

Face Recognition Using Kernel Based Fisher Discriminant Analysis

Kernel Inverse Fisher Discriminant Analysis for Face Recognition

Kernel discriminant analysis based on support vectors

Optimal Discriminant Analysis Based on Kernel Extension of Graph Embedding and Face Recognition