Large margin based nonnegative matrix factorization and partial least squares regression for face recognition

PanJi-Yuan,ZhangJiang-She

IF: 4.757

2011-01-01

Pattern Recognition Letters

Abstract:In this paper, we present a new method, called large margin based nonnegative matrix factorization (LMNMF), to encode latent discriminant information in training data. LMNMF seeks a nonnegative sub...

What problem does this paper attempt to address?

Large Margin Based Nonnegative Matrix Factorization and Partial Least Squares Regression for Face Recognition

Ji-Yuan Pan,Jiang-She Zhang

DOI: https://doi.org/10.1016/j.patrec.2011.07.015

IF: 4.757

2011-01-01

Pattern Recognition Letters

Abstract:In this paper, we present a new method, called large margin based nonnegative matrix factorization (LMNMF), to encode latent discriminant information in training data. LMNMF seeks a nonnegative subspace such that k nearest neighbors of each sample always belong to same class and samples from different classes are separated by a large margin. In the subspace, the local separation structure of data is explicit. The large-margin criterion leads to a new objective function, and a convergency provable multiplicative nonnegative updating rule is derived to learn the basis matrix and encoding vectors. Then, partial least squares regression (PLSR) learns the mapping from the original data to low dimensional representations in order to capture local separation information. PLSR offers a unified solution to out-of-sample extension problem. Extensive experimental results demonstrate LMNMF with PLSR leads significant improvements on classification than several other commonly used NMF-based algorithms.
Bilateral Structure Based Matrix Regression Classification for Face Recognition

Jian-Xun Mi,Zhiheng Luo,Li-Fang Zhou,Fujin Zhong

DOI: https://doi.org/10.1016/j.neucom.2018.05.123

IF: 6

2019-01-01

Neurocomputing

Abstract:Robust sparse representation is a well-known method in computer vision. Many sparse representation models have been proposed and perform well in face recognition. Most of them use transformed images of one dimensional vector, and such implementation ignores structural information between features. To make use of this structural information, this paper presents a novel model for face recognition. Unlike traditional sparse regression measuring differences between test sample and predicted response by vector norm, our model uses matrix norm, l2,1, to calculate residual. Instead of treating each pixel independently, the residual of a pixel is connected with all other pixels from the same line and column by means of double direction l2,1-norm. Moreover, we incorporate the specific class information into the representation model by introducing group-sparse regularizer. And then, we use the alternating direction method of multipliers approach to optimize proposed model. The extensive experiments have been conducted to evaluate the proposed methods by comparing with many sparse representation based techniques.
Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Lifang Zhou,Bin Fang,Weisheng Li,Lidou Wang

2013-01-01

Abstract:Global features-based methods and local features -based methods have been very successful in face recognition system, yet they can be combined together and jointly optimized so as to minimize the error of a nearest-neighbor classifier. We consider both descriptor for face images with Local Multiple Pattern, and discriminant learning techniques with Exponential Discriminant Analysis. A combination framework based on Local Multiple Pattern and Exponential Discriminant Analysis has been proposed in this paper. Firstly, our approach encodes the multi-scale face feature by Local Multiple Pattern, and then they have been extended to strengthen the discriminative ability by Exponential Discriminant Analysis; Secondly, we suggest to use the above feature on different layers independently so that a multiple classifier system can be attained. Using these techniques, we obtain the state-of-the-art performance on two public available databases. © 2013 IFSA.
Sparse Non-negative Matrix Factorization Based on Spatial Pyramid Matching for Face Recognition

Xianzhong Long,Hongtao Lu,Yong Peng

DOI: https://doi.org/10.1109/IHMSC.2013.27

2013-01-01

Abstract:The non-negative matrix factorization (NMF) is a part-Based image representation method which allows only additive combinations of non-negative basis components. NMF has been widely used as a dimensionality reduction technique to solve problems in computer vision and pattern recognition fields. The sparse representation and spatial information of image are also important, however, existing NMF methods do not take these two aspects into consideration simultaneously. In this paper, we propose a novel NMF method with spatial information for face recognition, which is called sparse non-negative matrix factorization Based on spatial pyramid matching (SNMFSPM). Experimental results on several benchmark databases show that the proposed scheme outperforms some classical methods.
Graph Regularized Discriminative Non-Negative Matrix Factorization for Face Recognition

Xianzhong Long,Hongtao Lu,Yong Peng,Wenbin Li

DOI: https://doi.org/10.1007/s11042-013-1572-z

IF: 2.577

2013-01-01

Multimedia Tools and Applications

Abstract:Non-negative matrix factorization (NMF) has been widely employed in computer vision and pattern recognition fields since the learned bases can be interpreted as a natural parts-based representation of the input space, which is consistent with the psychological intuition of combining parts to form a whole. In this paper, we propose a novel constrained nonnegative matrix factorization algorithm, called the graph regularized discriminative non-negative matrix factorization (GDNMF), to incorporate into the NMF model both intrinsic geometrical structure and discriminative information which have been essentially ignored in prior works. Specifically, both the graph Laplacian and supervised label information are jointly utilized to learn the projection matrix in the new model. Further we provide the corresponding multiplicative update solutions for the optimization framework, together with the convergence proof. A series of experiments are conducted over several benchmark face datasets to demonstrate the efficacy of our proposed GDNMF.
Robust discriminative non-negative matrix factorization.

Ruiqing Zhang,Zhenfang Hu,Gang Pan,Yueming Wang

DOI: https://doi.org/10.1016/j.neucom.2015.07.032

IF: 6

2016-01-01

Neurocomputing

Abstract:Traditional non-negative matrix factorization (NMF) is an unsupervised method that represents non-negative data by a part-based dictionary and non-negative codes. Recently, the unsupervised NMF has been extended to discriminative ones for classification problems. However, these discriminative methods may become inefficient when outliers are presented in the data, e.g. mislabeled samples, because the outliers usually deviate from the normal samples in one class and would perturb the discriminative dictionary. In this paper, we propose a novel method, called robust discriminative non-negative matrix factorization (RDNMF), to reduce the effect of outliers and improve the discriminative strength. The RDNMF learns a non-negative dictionary for each class, and each dictionary contains two parts: a discriminative part and an outlier part. The discriminative parts are obtained by minimizing the cosine similarity between classes. The codes on the outlier part are required to be sparse so that most outliers can be modeled by this part, without large influence over the discriminative part.The final dictionary is obtained by concatenating the discriminative parts of all classes, and the non-negative codes for each sample, as well as test sample, are obtained by coding with this dictionary. Experimental comparisons with existing dictionary learning methods on MNIST, PIE, Yale B and ORL demonstrate the effectiveness and robustness of our approach.
A modified non-negative Matrix Factorization algorithm for face recognition

Xue Yun,Tong Chong Sze,Chen Wen-Sheng,Zhang Weipeng,He Zhenyu,Y Xue,CS Tong,WS Chen,W Zhang

DOI: https://doi.org/10.1109/ICPR.2006.104

2006-01-01

Abstract:In this paper, we propose a new variation of the Non-negative Matrix Factorization (NMF) for face recognition. The original NMF algorithm is distinguished from the other methods of pattern recognition by its non-negativity constraints which lead to a parts-based representation because they allow only additive combinations. However, it should be considered as an unsupervised method since class information in the training set is not used. To take advantage of more information in the training images and improve the performance for classification problem, we integrate the Fisher Linear Discriminant Analysis into the NMF algorithm, which results in a novel Modified Non-negative Matrix Factorization algorithm. Our new update rule guarantees the non-negativity for all the coefficients and hence preserve the intuitive meaning for the base vectors and weight vectors while facilitating the supervised learning of within-class information. Our new technique is tested on a well-known face database: the ORL Face Database. The experimental results are very encouraging and outperformed traditional techniques including the original NMF and the Eigen-face method.
Face Recognition Using Fisher Non-Negative Matrix Factorization With Sparseness Constraints

Xr Pu,Z Yi,Zm Zheng,W Zhou,M Ye

DOI: https://doi.org/10.1007/11427445_19

2005-01-01

Abstract:A novel subspace method is proposed for part-based face recognition by using non-negative matrix factorization with sparseness constraints (NMFs) and Fisher's linear discriminant (FLD) hence its abbreviation, FNMFs. A comparative analysis engages PCA+FLD (FPCA) method and FNMFs method for both part-based and holistic-based face recognition. The comparative experiments axe completed for the ORL face database and UMIST face database, it shows that FNMFs has better performance than FPCA-based method both for holistic-face and parts-face images recognition.
Robust Structured Nonnegative Matrix Factorization for Image Representation.

Zechao Li,Jinhui Tang,Xiaofei He

DOI: https://doi.org/10.1109/TNNLS.2017.2691725

IF: 14.255

2018-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Dimensionality reduction has attracted increasing attention, because high-dimensional data have arisen naturally in numerous domains in recent years. As one popular dimensionality reduction method, nonnegative matrix factorization (NMF), whose goal is to learn parts-based representations, has been widely studied and applied to various applications. In contrast to the previous approaches, this pape...
Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Lijian Zhou,Hui Wang,Zhe-Ming Lu,Tingyuan Nie,Kun Zhao

2016-01-01

Abstract:The accurate alignment for different face images acquired in different conditions is very difficult because face appearance and noise are complex and variable. For solving this question, an Improved Pairwise-constrained Multiple Metric Learning method (IPMML) is proposed as a classification metric, which can obtain a Mahalanobis matrix by PMML between a testing face image and a training face image instead of all training face images. However, the calculation of the IPMML is complicated and time consuming for the data with high dimension. Therefore, Linear Discriminant Analysis (LDA) is selected to decrease the feature dimension and enhance recognition accuracy. Thus, a novel face recognition method based on LDA and IPMML is proposed. First, the fisher features of a face image are extracted using the LDA method. Then, the extracted features are divided into a number of blocks according to the feature dimension and every block is changed to a column vector. Third, the IPMML is used to compute the Mahalanobis matrices between the testing sample blocks and every training sample blocks. Fourth, the final discriminative distance is obtained using the optimum Mahalanobis matrices. Finally, the Nearest Neighborhood Classifier (NNC) is performed to recognize face. The experimental results based on Yale, Extended Yale B, and AR Databases showed that the proposed method can recognize face effectively and reliably, especially for the little training sample number and misalignment conditions.
Joint latent low-rank and non-negative induced sparse representation for face recognition

Mingna Wu,Shu Wang,Zhigang Li,Long Zhang,Ling Wang,Zhenwen Ren

DOI: https://doi.org/10.1007/s10489-021-02338-x

IF: 5.3

2021-04-02

Applied Intelligence

Abstract:Representation-based methods have achieved exciting results in recent applications of face recognition. However, it is still challenging for the face recognition task due to noise and outliers in the data. Many existing methods avoid these problems by constructing an auxiliary dictionary from the extended data but fail to achieve good performances because they use the main dictionary only for classification. In this paper, to avoid the need to manually construct an auxiliary dictionary and the effects of noise, we propose a Joint Latent Low-Rank and Non-Negative Induced Sparse Representation (JLSRC) for face recognition. Specifically, JLSRC adaptively learns two clean low-rank reconstructed dictionaries jointly via an extended latent low-rank representation to reveal the potential relationships in the data and then embeds a non-negative constraint and an Elastic Net regularization in the coefficient vectors of the dictionaries to enhance the performance on classification. In this way, the learned low-rank dictionaries can be mutually boosted to extract discriminative features and handle the noise, and the obtained coefficient vectors are simultaneously both sparse and discriminative. Moreover, the proposed method seamlessly and elegantly integrates low-rank learning and sparse representation-based classification. Extensive experiments on three challenging face databases demonstrate the effectiveness and robustness of JLSRC in comparison with the state-of-the-art methods.

computer science, artificial intelligence
Nonnegative Tensor Factorization Based on Low-Rank Subspace for Facial Expression Recognition

Liu Xingang,Li Chenqi,Dai Cheng,Lai Jinfeng,Chao Han-Chieh

DOI: https://doi.org/10.1007/s11036-020-01709-x

2021-01-01

Mobile Networks and Applications

Abstract:Important progresses have been made in the field of artificial intelligence in recent years, and facial expression recognition (FER), which could greatly facilitate the development of human-computer interaction, has been becoming a significant research hotspot. In this paper, a novel nonnegative tensor factorization method is proposed based on low-rank subspace (NTF − LRS) for FER. Firstly, in order to find the high order correlations underlying multi-dimensional data, a data tensor model is constructed, which could represent different dimensional features ingeniously. And then, the low-rank subspace model is adopted to reconstruct the original tensor model, reduce the redundancy of the learned new tensor, and improve the discriminant abilities of inter-class information. Finally, the reconstructed tensor is decomposed to get factor matrices by nonnegative tensor factorization, where all factor matrices are used to extract subspace features. To verify the effectiveness of our proposal, two well-known facial expression datasets named as “JAFFE” and “CK+” are utilized for evaluation, and the experimental results show that the tensor-based method preserves the original structure of whole samples, which avoids the case of dimension curse because of vectorization. In addition, this method uses Laplacian graph to impose regularization on low-rank subspace model, which keeps the local relationship between sample neighbors.
Wavelet-based Non-negative Matrix Factorization with Sparseness Constraints for Face Recognition

OUYANG Yi-biao,PU Xiao-rong,ZHANG Yi

DOI: https://doi.org/10.3969/j.issn.1001-3695.2006.10.055

2006-01-01

Abstract:This paper combines Wavelet Transformation(WT),Non-negative Matrix Factorization with sparseness constraints(NMFs),and Fisher's Linear Discriminant(FLD) to extract features for face recognition.Wavelet transformation is used to decompose face images and for choosing the lowest resolution sub-band coefficients so that the substantial facial features can be captured and the computational complexity can be reduced.NMFs can control sparseness explicitly and find parts-based representations for face images.FLD plays the role of forming well-separated classes in a low-dimensional subspace.Extensive experiments are carried out to illustrate the proposed combine face recognition method by using the ORL face database.The experimental results show that the method has robust high-performance against varying illumination,facial expression and part occlusion.
Non-negative Matrix Factorization Via Discriminative Label Embedding for Pattern Classification.

Wenjie Zhu,Yunhui Yan

DOI: https://doi.org/10.1016/j.jvcir.2018.06.030

IF: 2.887

2018-01-01

Journal of Visual Communication and Image Representation

Abstract:As one of the most commonly used dimension reduction approaches, discriminant non-negative matrix factorization (NMF) has been widely used for data representation in the pattern classification task. However, the previous discriminant NMFs emphasize the Fisher criterion or maximum margin criterion which has high requirement to the distribution of data. Therefore, this work proposes a discriminative label embedded NMF (LENMF) algorithm. LENMF takes into account the discriminative label embedding to obtain the low-dimensional projected data and orthogonal property of the non-negative basis to strength the ability of parts-based representation. Besides, LENMF is extended in the kernel space to explore the nonlinear relations of data. By integrating the non-negative constraint, discriminative label embedding, and the orthogonal property into the proposed objective, the multiplicative updating rules have been given in this work. Experiment results on the challenging face, object, document, and digit databases illustrate the performance of the proposed algorithm.
Two-dimensional non-negative matrix factorization for face representation and recognition

Daoqiang Zhang,Songcan Chen,Zhi-Hua Zhou

DOI: https://doi.org/10.1007/11564386_27

2005-01-01

Abstract:Non-negative matrix factorization (NMF) is a recently developed method for finding parts-based representation of non-negative data such as face images. Although it has successfully been applied in several applications, directly using NMF for face recognition often leads to low performance. Moreover, when performing on large databases, NMF needs considerable computational costs. In this paper, we propose a novel NMF method, namely 2DNMF, which stands for 2-D non-negative matrix factorization. The main difference between NMF and 2DNMF is that the former first align images into 1D vectors and then represents them with a set of 1D bases, while the latter regards images as 2D matrices and represents them with a set of 2D bases. Experimental results on several face databases show that 2DNMF has better image reconstruction quality than NMF under the same compression ratio. Also the running time of 2DNMF is less, and the recognition accuracy higher than that of NMF.
Group Sparse Non-Negative Matrix Factorization For Multi-Manifold Learning

xiangyang liu,hongtao lu,hua gu,shanghai jiao

DOI: https://doi.org/10.5244/C.25.56

2011-01-01

Abstract:Many observable data sets such as images, videos and speech can be modeled by a mixture of manifolds which are the result of multiple factors (latent variables). In this paper, we propose a novel algorithm to learn multiple linear manifolds for face recognition, called Group Sparse Non-negative Matrix Factorization (GSNMF). Via the group sparsity constraint imposed on the column vectors of the coefficient matrix, we obtain multiple linear manifolds each of them belongs to a particular class. For a test image, we represent it as a linear combination of the learned multiple linear manifolds, and then the representation is naturally group sparse: only the coefficients corresponding to the same class are nonzero. We conduct extensive experiments to verify the proposed algorithm using the ORL database, the Yale database and the Extended Yale B database. Our evaluation shows that GSNMF achieves accurate recognition on face images with varying illuminations and expressions.
Large-Cone Nonnegative Matrix Factorization

Tongliang Liu,Mingming Gong,Dacheng Tao

DOI: https://doi.org/10.1109/tnnls.2016.2574748

IF: 14.255

2016-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:Nonnegative matrix factorization (NMF) has been greatly popularized by its parts-based interpretation and the effective multiplicative updating rule for searching local solutions. In this paper, we study the problem of how to obtain an attractive local solution for NMF, which not only fits the given training data well but also generalizes well on the unseen test data. Based on the geometric interpretation of NMF, we introduce two large-cone penalties for NMF and propose large-cone NMF (LCNMF) algorithms. Compared with NMF, LCNMF will obtain bases comprising a larger simplicial cone, and therefore has three advantages. 1) the empirical reconstruction error of LCNMF could mostly be smaller; (2) the generalization ability of the proposed algorithm is much more powerful; and (3) the obtained bases of LCNMF have a low-overlapping property, which enables the bases to be sparse and makes the proposed algorithms very robust. Experiments on synthetic and real-world data sets confirm the efficiency of LCNMF.
Learning Parts-Based and Global Representation for Image Classification.

Yuwu Lu,Zhihui Lai,Xuelong Li,David Zhang,Wai Keung Wong,Chun Yuan

DOI: https://doi.org/10.1109/tcsvt.2017.2749980

IF: 5.859

2018-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Nonnegative matrix factorization (NMF), known as a famous matrix factorization technique, has been widely used in pattern recognition and computer vision. NMF represents the input data matrix as a product of two nonnegative factors. As NMF is based on the Euclidean distance, which is sensitive to noise or errors in the data, some robust NMF methods are proposed. Mainly focusing on parts-based representation, these robust NMF methods often neglect global representation of data. In fact, the global geometry information of data is more robust than the local information about the noisy data in terms of image classification. In order to effectively improve the robustness of NMF and learn part-based and global representation of the data, a novel method low-rank nonnegative factorization (LRNF) is proposed in this paper. First, we assume that the data are grossly corrupted, and the $L_{1} $ norm is used as a sparse constraint on the assumed noise matrix. Then, LRNF learns a low-rank matrix with the global representation ability. Finally, we make a nonnegative factorization of the learned low-rank matrix. We can obtain a base matrix, which preserves locality and globality properties of the data in the meantime. Extensive experiments have been conducted on nine real-world image databases to verify the performance of the proposed LRNF method by comparing with the state-of-the-art algorithms on robust dimensionality reduction.
Non-negative Matrix Factorization Based Methods for Object Recognition

WX Liu,NN Zheng

DOI: https://doi.org/10.1016/j.patrec.2004.02.002

IF: 4.757

2004-01-01

Pattern Recognition Letters

Abstract:Non-negative matrix factorization (NMF) is a new feature extraction method. But the learned feature vectors are not directly suitable for further analysis such as object recognition using the nearest neighbor classifier in contrast to traditional principal component analysis (PCA) because the learned bases are not orthonormal to each other. This paper investigates how to improve the accuracy of recognition based on this new method from two viewpoints. One is to adopt a Riemannian metric like distance for the learned feature vectors instead of Euclidean distance. The other is to first orthonormalize the learned bases and then to use the projections of data based on the orthonormalized bases for further recognition. Experiments on the USPS database demonstrate the proposed methods can improve accuracy and even outperform PCA. We believe that the proposed methods can make NMF used as widely as PCA.
Learning latent features by nonnegative matrix factorization combining similarity judgments

ZhangJiang-She,WangChang-Peng,YangYu-Qian

IF: 6

2015-01-01

Neurocomputing

Abstract:Nonnegative matrix factorization (NMF) is a popular method for learning low-rank approximation of nonnegative matrix. However, aiming at seeking the low-rank approximation from the viewpoint of dat...

Large margin based nonnegative matrix factorization and partial least squares regression for face recognition

Large Margin Based Nonnegative Matrix Factorization and Partial Least Squares Regression for Face Recognition

Bilateral Structure Based Matrix Regression Classification for Face Recognition

Combination of Local Multiple Patterns and Exponential Discriminant Analysis for facial recognition

Sparse Non-negative Matrix Factorization Based on Spatial Pyramid Matching for Face Recognition

Graph Regularized Discriminative Non-Negative Matrix Factorization for Face Recognition

Robust discriminative non-negative matrix factorization.

A modified non-negative Matrix Factorization algorithm for face recognition

Face Recognition Using Fisher Non-Negative Matrix Factorization With Sparseness Constraints

Robust Structured Nonnegative Matrix Factorization for Image Representation.

Face Recognition Based on LDA and Improved Pairwise-Constrained Multiple Metric Learning Method.

Joint latent low-rank and non-negative induced sparse representation for face recognition

Nonnegative Tensor Factorization Based on Low-Rank Subspace for Facial Expression Recognition

Wavelet-based Non-negative Matrix Factorization with Sparseness Constraints for Face Recognition

Non-negative Matrix Factorization Via Discriminative Label Embedding for Pattern Classification.

Two-dimensional non-negative matrix factorization for face representation and recognition

Group Sparse Non-Negative Matrix Factorization For Multi-Manifold Learning

Large-Cone Nonnegative Matrix Factorization

Learning Parts-Based and Global Representation for Image Classification.

Non-negative Matrix Factorization Based Methods for Object Recognition

Learning latent features by nonnegative matrix factorization combining similarity judgments