Two Improvements of NMF Used for Tumor Clustering

Zhong-Yuan Zhang,Xiang-Sun Zhang

2007-01-01

Abstract:Non-negative Matrix Factorization (NMF) is one of the promising methods used in data mining, such as clustering human tumor samples into different types or subtypes based on microarray technology. In this paper we briefly review this method, especially when it is used for tumor clustering, and present two small but effective improvements.

What problem does this paper attempt to address?

NMF-based Method for Data Classification

张忠元,章祥荪

DOI: https://doi.org/10.3778/j.issn.100--8331.2010.16.071

2010-01-01

Abstract:In bioinformatics,an important task is to classify tumor samples into different classes based on microarray technology which enables people to monitor entire genome in a single chip using a system's approach.The key difficulty of this problem,compared with many traditional classification problems,is the high dimensionality in gene space and the small number of samples that will be classified.Non-negative Matrix Factorization(NMF) has coped with this difficulty successfully in microarray data clustering.NMF is extended to tumor classification and the result shows its competition.NMF-based method has three advantages:Good classification performance,parameter-independent and good interpretability.
Tumor clustering using nonnegative matrix factorization with gene selection.

Chun-Hou Zheng,De-Shuang Huang,Lei Zhang,Xiang-Zhen Kong

DOI: https://doi.org/10.1109/TITB.2009.2018115

2009-01-01

Abstract:Tumor clustering is becoming a powerful method in cancer class discovery. Nonnegative matrix factorization (NMF) has shown advantages over other conventional clustering techniques. Nonetheless, there is still considerable room for improving the performance of NMF. To this end, in this paper, gene selection and explicitly enforcing sparseness are introduced into the factorization process. Particularly, independent component analysis is employed to select a subset of genes so that the effect of irrelevant or noisy genes can be reduced. The NMF and its extensions, sparse NMF and NMF with sparseness constraint, are then used for tumor clustering on the selected genes. A series of elaborate experiments are performed by varying the number of clusters and the number of selected genes to evaluate the cooperation between different gene selection settings and NMF-based clustering. Finally, the experiments on three representative gene expression datasets demonstrated that the proposed scheme can achieve better clustering results.
Improving Tumor Clustering Based on Gene Selection

Xiangzhen Kong,Chunhou Zheng,Yuqiang Wu,Yutian Wang

DOI: https://doi.org/10.1007/978-3-540-87442-3_6

2008-01-01

Abstract:Tumor clustering is becoming a powerful method in cancer class discovery. In this community, non-negative matrix factorization (NMF) has shown its advantages, such as the accuracy and robustness of the representation, over other conventional clustering techniques. Though NMF has shown its efficiency in tumor clustering, there is a considerable room for improvement in clustering accuracy and robustness. In this paper, gene selection and explicitly enforcing sparseness are introduced into clustering process. The independent component analysis (ICA) is employed to select a subset of genes. The unsupervised methods NMF and its extensions, sparse NMF (SNMF) and NMF with sparseness constraint (NMFSC), are then used for tumor clustering on the subset of genes selected by ICA. The experimental results demonstrate the efficiency of the proposed scheme.
NMF-based Models for Tumor Clustering: A Systematic Comparison

Zhong-Yuan Zhang

2009-01-01

Abstract:Nonnegative Matrix Factorization (NMF) is one of the famous unsupervised learning models. In this paper, we give a short survey on NMF-related models, including K-means, Probabilistic Latent Semantic Indexing etc. and present a new Posterior Probabilistic Clustering model, and compare their numerical experimental results on five real microarray data. The results show that i) NMF using with K-L divergence objective function has better clustering performance; ii) Our purposed PPC model is among the best.
Tumor Classification Using Non-negative Matrix Factorization

Ping Zhang,Chun-hou Zheng,Bo Li,Chang-gang Wen

DOI: https://doi.org/10.1007/978-3-540-85930-7_32

2008-01-01

Abstract:With the advent of DNA microarrys, it is now possible to use the microarry data for tumor classification. Yet previous works have not use the non-negative information of gene expression data for classification. In this paper, we propose a new method for tumor classification using gene expression data. In this method, we first extract new features of the gene expression data by virtue of non-negative matrix factorization (NMF) and its extension, i.e. sparse NMF (SNMF) then apply support vector machines (SVM) to classify the tumor samples using the extracted features. To better fit for classification aim, a new SNMF algorithm is also proposed.
Molecular Cancer Class Discovery Using Non-Negative Matrix Factorization With Sparseness Constraint

Xiangzhen Kong,Chunhou Zheng,Yuqiang Wu,Li Shang

DOI: https://doi.org/10.1007/978-3-540-74171-8_79

2007-01-01

Abstract:In cancer diagnosis and treatment, clustering based on gene expression data has been shown to be a powerful method in cancer class discovery. In this paper, we discuss the use of nonnegative matrix factorization with sparseness constraints (NMFSC), a method which can be used to learn a parts representation of the data, to analysis gene expression data. We illustrate how to choose appropriate sparseness factors in the algorithm and demonstrate the improvement of NMFSC by direct comparison with the nonnegative matrix factorization (NMF). In addition, when using it on the two well-studied datasets, we obtain pretty much the same results with the sparse non-negative matrix factorization (SNMF).
Tumor Classification Based on Non-Negative Matrix Factorization Using Gene Expression Data

Chun-Hou Zheng,To-Yee Ng,Lei Zhang,Chi-Keung Shiu,Hong-Qiang Wang

DOI: https://doi.org/10.1109/tnb.2011.2144998

IF: 3.9

2011-01-01

IEEE Transactions on NanoBioscience

Abstract:This paper presents a new method for tumor classification using gene expression data. In the proposed method, we first select genes using nonnegative matrix factorization (NMF) or sparse NMF (SNMF), and then we extract features from the selected genes by virtue of NMF or SNMF. At last, we apply support vector machines (SVM) to classify the tumor samples using the extracted features. In order for a better classification, a modified SNMF algorithm is also proposed. The experimental results on benchmark three microarray data sets validate that the proposed method is efficient. Moreover, the biological meaning of the selected genes are also analyzed.
A Robust Manifold Graph Regularized Nonnegative Matrix Factorization Algorithm for Cancer Gene Clustering

Rong Zhu,Jin-Xing Liu,Yuan-Ke Zhang,Ying Guo

DOI: https://doi.org/10.3390/molecules22122131

2017-01-01

Abstract:Detecting genomes with similar expression patterns using clustering techniques plays an important role in gene expression data analysis. Non-negative matrix factorization (NMF) is an effective method for clustering the analysis of gene expression data. However, the NMF-based method is performed within the Euclidean space, and it is usually inappropriate for revealing the intrinsic geometric structure of data space. In order to overcome this shortcoming, Cai et al. proposed a novel algorithm, called graph regularized non-negative matrices factorization (GNMF). Motivated by the topological structure of the GNMF-based method, we propose improved graph regularized non-negative matrix factorization (GNMF) to facilitate the display of geometric structure of data space. Robust manifold non-negative matrix factorization (RM-GNMF) is designed for cancer gene clustering, leading to an enhancement of the GNMF-based algorithm in terms of robustness. We combine the l 2 , 1 -norm NMF with spectral clustering to conduct the wide-ranging experiments on the three known datasets. Clustering results indicate that the proposed method outperforms the previous methods, which displays the latest application of the RM-GNMF-based method in cancer gene clustering.
Dual Hyper-Graph Regularized Supervised NMF for Selecting Differentially Expressed Genes and Tumor Classification.

Chuan-Yuan Wang,Na Yu,Ming-Juan Wu,Ying-Lian Gao,Jin-Xing Liu,Juan Wang

DOI: https://doi.org/10.1109/tcbb.2020.2975173

2021-01-01

IEEE/ACM Transactions on Computational Biology and Bioinformatics

Abstract:Non-negative matrix factorization (NMF) is a dimensionality reduction technique based on high-dimensional mapping. It can learn part-based representations effectively. In this paper, we propose a method called Dual Hyper-graph Regularized Supervised Non-negative Matrix Factorization (HSNMF). To encode the geometric information of the data, the hyper-graph is introduced into the model as a regularization term. The advantage of hyper-graph learning is to find higher order data relationship to enhance data relevance. This method constructs the data hyper-graph and the feature hyper-graph to find the data manifold and the feature manifold simultaneously. The application of hyper-graph theory in cancer datasets can effectively find pathogenic genes. The discrimination information is further introduced into the objective function to obtain more information about the data. Supervised learning with label information greatly improves the classification effect. Furthermore, the real datasets of cancer usually contain sparse noise, so the L2,1-norm is applied to enhance the robustness of HSNMF algorithm. Experiments under The Cancer Genome Atlas (TCGA) datasets verify the feasibility of the HSNMF method.
Gene Expression Data Classification Based on Non-Negative Matrix Factorization

Chun-Hou Zheng,Ping Zhang,Lei Zhang,Xin-Xin Liu,Ju Han

DOI: https://doi.org/10.1109/ijcnn.2009.5178606

2009-01-01

Abstract:With the advent of DNA microarrays, it is now possible to use the microarrays data for tumor classification. Yet previous works have not use the nonnegative information of gene expression data. In this paper, we propose a new method for tumor classification using gene expression data. In this method, we first select genes using nonnegative matrix factorization (NMF) and sparse NMF (SNMF). Then we extract features of the selected gene data by virtue of NMF and SNMF. At last, support vector machines (SVM) was applied to classify the tumor samples based on the extracted features. To better fit for classification aim, a modified SNMF algorithm is also proposed. The experimental results on three microarray datasets show that the method is efficient and feasible.
Clustering of gene expression data based on non-negative matrix factorization by maximizing correntropy

Xiaofen Tang,Li Chen

DOI: https://doi.org/10.3969/j.issn.1001-4160.2013.11.030

2013-01-01

Abstract:Non-negative matrix factorization (NMF) has been shown to be a powerful tool for clustering gene expression data, which are widely used to classify cancers. We summarized several methods of NMF and similarity between the product of the two matrices and the original matrix. Correntropy was recently shown to be an effective similarity measurement due to its stability to outliers or noise. So we introduce a maximum correntropy criterion (MCC)-based NMF method (NMF-MCC). Extensive experiments on five cancer benchmark sets demonstrate that the introduced method is significantly more accurate than the state-of-the-art methods in cancer clustering. At last, we introduced several performance metrics of clustering.
Correntropy-Based Hypergraph Regularized NMF for Clustering and Feature Selection on Multi-Cancer Integrated Data.

Na Yu,Ming-Juan Wu,Jin-Xing Liu,Chun-Hou Zheng,Yong Xu

DOI: https://doi.org/10.1109/tcyb.2020.3000799

IF: 11.8

2021-01-01

IEEE Transactions on Cybernetics

Abstract:Non-negative matrix factorization (NMF) has become one of the most powerful methods for clustering and feature selection. However, the performance of the traditional NMF method severely degrades when the data contain noises and outliers or the manifold structure of the data is not taken into account. In this article, a novel method called correntropy-based hypergraph regularized NMF (CHNMF) is proposed to solve the above problem. Specifically, we use the correntropy instead of the Euclidean norm in the loss term of CHNMF, which will improve the robustness of the algorithm. And the hypergraph regularization term is also applied to the objective function, which can explore the high-order geometric information in more sample points. Then, the half-quadratic (HQ) optimization technique is adopted to solve the complex optimization problem of CHNMF. Finally, extensive experimental results on multi-cancer integrated data indicate that the proposed CHNMF method is superior to other state-of-the-art methods for clustering and feature selection.
Adaptive Factorization Rank Selection-Based NMF and Its Application in Tumor Recognition.

Yang Xiaohui,Wu Wenming,Xin,Su Limin,Xue Liugen

DOI: https://doi.org/10.1007/s13042-021-01353-1

2021-01-01

International Journal of Machine Learning and Cybernetics

Abstract:The nonnegative matrix factorization (NMF) has been widely used because it can accomplish both feature representation learning and dimension reduction. However, there are two critical and challenging issues affecting the performance of NMF models. One is the selection of matrix factorization rank, while most of the existing methods are based on experiments or experience. For tackling this issue, an adaptive and stable NMF model is constructed based on an adaptive factorization rank selection (AFRS) strategy, which skillfully and simply integrates a row constraint similar to the generalized elastic net. The other is the sensitivity to the initial value of the iteration, which seriously affects the result of matrix factorization. This issue is alleviated by complementing NMF and deep learning each other and avoiding complex network structure. The proposed NMF model is called deep AFRS-NMF model for short, and the corresponding optimization solution, convergence and stability are analyzed. Moreover, the statistical consistency is discussed between the rank obtained by the proposed model and the ideal rank. The performance of the proposed deep AFRS-NMF model is demonstrated by applying in genetic data-based tumor recognition. Experiments show that the factorization rank obtained by the deep AFRS-NMF model is stable and superior to classical and state-of-the-art methods.
On -Divergence Based Nonnegative Matrix Factorization for Clustering Cancer Gene Expression Data

Weixiang Liu,Kehong Yuan,Datian Ye

DOI: https://doi.org/10.1016/j.artmed.2008.05.001

IF: 7.011

2008-01-01

Artificial Intelligence in Medicine

Abstract:Nonnegative matrix factorization (NMF) has been proven to be a powerful clustering method. Recently Cichocki and coauthors have proposed a family of new algorithms based on the alpha-divergence for NMF. However, it is an open problem to choose an optimal alpha.In this paper, we tested such NMF variant with different alpha values on clustering cancer gene expression data for optimal alpha selection experimentally with 11 datasets.Our experimental results show that alpha=1 and 2 are two special optimal cases for real applications.
Comparison of non-negative matrix factorization methods for clustering genomic data

Hou Mi-Xiao,Gao Ying-Lian,Liu Jin-Xing,Shang Jun-Liang,Zheng Chun-Hou

DOI: https://doi.org/10.1007/978-3-319-42294-7_25

2016-01-01

Abstract:Non-negative matrix factorization (NMF) is a useful method of data dimensionality reduction and has been widely used in many fields, such as pattern recognition and data mining. Compared with other traditional methods, it has unique advantages. And more and more improved NMF methods have been provided in recent years and all of these methods have merits and demerits when used in different applications. Clustering based on NMF methods is a common way to reflect the properties of methods. While there are no special comparisons of clustering experiments based on NMF methods on genomic data. In this paper, we analyze the characteristics of basic NMF and its classical variant methods. Moreover, we show the clustering results based on the coefficient matrix decomposed by NMF methods on the genomic datasets. We also compare the clustering accuracies and the cost of time of these methods. © Springer International Publishing Switzerland 2016.
On α-divergence based nonnegative matrix factorization for clustering cancer gene expression data

Weixiang Liu,Kehong Yuan,Datian Ye

DOI: https://doi.org/10.1016/j.artmed.2008.05.001

IF: 7.011

2008-01-01

Artificial Intelligence in Medicine

Abstract:Objective: Nonnegative matrix factorization (NMF) has been proven to be a powerful clustering method. Recently Cichocki and coauthors have proposed a family of new algorithms based on the a-divergence for NMF However, it is an open problem to choose an optimal alpha. Methods and materials: In this paper, we tested such NMF variant with different a values on clustering cancer gene expression data for optimal a selection experimentally with 11 datasets. Results and conclusion: Our experimental results show that alpha = 1 and 2 are two special optimal cases for real applications. (C) 2008 Elsevier B.V. All rights reserved.
Research on the Advances of Nonnegative Matrix Factorization and Its Application in Bioinformatics

Jin-long SHI,Zhi-gang LUO

DOI: https://doi.org/10.3969/j.issn.1007-130X.2010.08.032

2010-01-01

Abstract:Nonnegative Matrix Factorization (NMF) is a rapidly developing parts-based machine learning algorithm,which can be used as a tool of dimensionality reduction and can identify the local features for high-dimensional data. NMF has a broad application in the analysis and interpretation of biological data,and a number of practical algorithms have been derived from it. This paper systematically analyzes the mathematical foundation of NMF and its advantages for the representation of local features,and surveys the advances of different varieties,initialization and parameter selection for the NMF algorithm. Also,its application in bioinformatics is reviewed and classified into several categories. Finally,the future directions of the NMF research and application are analyzed and predicted.
Two-Dimensional Semi-Nonnegative Matrix Factorization for Clustering

Chong Peng,Zhilu Zhang,Zhao Kang,Chenglizhao Chen,Qiang Cheng

DOI: https://doi.org/10.48550/arXiv.2005.09229

2020-05-19

Abstract:In this paper, we propose a new Semi-Nonnegative Matrix Factorization method for 2-dimensional (2D) data, named TS-NMF. It overcomes the drawback of existing methods that seriously damage the spatial information of the data by converting 2D data to vectors in a preprocessing step. In particular, projection matrices are sought under the guidance of building new data representations, such that the spatial information is retained and projections are enhanced by the goal of clustering, which helps construct optimal projection directions. Moreover, to exploit nonlinear structures of the data, manifold is constructed in the projected subspace, which is adaptively updated according to the projections and less afflicted with noise and outliers of the data and thus more representative in the projected space. Hence, seeking projections, building new data representations, and learning manifold are seamlessly integrated in a single model, which mutually enhance other and lead to a powerful data representation. Comprehensive experimental results verify the effectiveness of TS-NMF in comparison with several state-of-the-art algorithms, which suggests high potential of the proposed method for real world applications.

Machine Learning
Non-negative matrix factorization by maximizing correntropy for cancer clustering

Jim Jing-Yan Wang,Xiaolei Wang,Xin Gao

DOI: https://doi.org/10.1186/1471-2105-14-107

IF: 3.307

2013-01-01

BMC Bioinformatics

Abstract:Background Non-negative matrix factorization (NMF) has been shown to be a powerful tool for clustering gene expression data, which are widely used to classify cancers. NMF aims to find two non-negative matrices whose product closely approximates the original matrix. Traditional NMF methods minimize either the l 2 norm or the Kullback-Leibler distance between the product of the two matrices and the original matrix. Correntropy was recently shown to be an effective similarity measurement due to its stability to outliers or noise. Results We propose a maximum correntropy criterion (MCC)-based NMF method (NMF-MCC) for gene expression data-based cancer clustering. Instead of minimizing the l 2 norm or the Kullback-Leibler distance, NMF-MCC maximizes the correntropy between the product of the two matrices and the original matrix. The optimization problem can be solved by an expectation conditional maximization algorithm. Conclusions Extensive experiments on six cancer benchmark sets demonstrate that the proposed method is significantly more accurate than the state-of-the-art methods in cancer clustering.
Regularized Non-Negative Matrix Factorization for Identifying Differentially Expressed Genes and Clustering Samples: A Survey.

Jin-Xing Liu,Dong Wang,Ying-Lian Gao,Chun-Hou Zheng,Yong Xu,Jiguo Yu

DOI: https://doi.org/10.1109/tcbb.2017.2665557

2018-01-01

IEEE/ACM Transactions on Computational Biology and Bioinformatics

Abstract:Non-negative Matrix Factorization (NMF), a classical method for dimensionality reduction, has been applied in many fields. It is based on the idea that negative numbers are physically meaningless in various data-processing tasks. Apart from its contribution to conventional data analysis, the recent overwhelming interest in NMFis due to its newly discovered ability to solve challenging data mining and machine learning problems, especially in relation to gene expression data. This survey paper mainly focuses on research examining the application of NMF to identify differentially expressed genes and to cluster samples, and the mainNMF models, properties, principles, and algorithms with its various generalizations, extensions, and modifications are summarized. The experimental results demonstrate the performance of the various NMF algorithms in identifying differentially expressed genes and clustering samples.

Two Improvements of NMF Used for Tumor Clustering

NMF-based Method for Data Classification

Tumor clustering using nonnegative matrix factorization with gene selection.

Improving Tumor Clustering Based on Gene Selection

NMF-based Models for Tumor Clustering: A Systematic Comparison

Tumor Classification Using Non-negative Matrix Factorization

Molecular Cancer Class Discovery Using Non-Negative Matrix Factorization With Sparseness Constraint

Tumor Classification Based on Non-Negative Matrix Factorization Using Gene Expression Data

A Robust Manifold Graph Regularized Nonnegative Matrix Factorization Algorithm for Cancer Gene Clustering

Dual Hyper-Graph Regularized Supervised NMF for Selecting Differentially Expressed Genes and Tumor Classification.

Gene Expression Data Classification Based on Non-Negative Matrix Factorization

Clustering of gene expression data based on non-negative matrix factorization by maximizing correntropy

Correntropy-Based Hypergraph Regularized NMF for Clustering and Feature Selection on Multi-Cancer Integrated Data.

Adaptive Factorization Rank Selection-Based NMF and Its Application in Tumor Recognition.

On -Divergence Based Nonnegative Matrix Factorization for Clustering Cancer Gene Expression Data

Comparison of non-negative matrix factorization methods for clustering genomic data

On α-divergence based nonnegative matrix factorization for clustering cancer gene expression data

Research on the Advances of Nonnegative Matrix Factorization and Its Application in Bioinformatics

Two-Dimensional Semi-Nonnegative Matrix Factorization for Clustering

Non-negative matrix factorization by maximizing correntropy for cancer clustering

Regularized Non-Negative Matrix Factorization for Identifying Differentially Expressed Genes and Clustering Samples: A Survey.