Abstract:Non-negative matrix factorization (NMF) is a powerful machine learning method for decomposing a high-dimensional nonnegative matrix V into the product of two nonnegative matrices, W and H, such that V ∼ W H. It has been shown to have a parts-based, sparse representation of the data. NMF has been successfully applied in a variety of areas such as natural language processing, neuroscience, information retrieval, image processing, speech recognition and computational biology for the analysis and interpretation of large-scale data. There has also been simultaneous development of a related statistical latent class modeling approach, namely, probabilistic latent semantic indexing (PLSI), for analyzing and interpreting co-occurrence count data arising in natural language processing. In this paper, we present a generalized statistical approach to NMF and PLSI based on Renyi's divergence between two non-negative matrices, stemming from the Poisson likelihood. Our approach unifies various competing models and provides a unique theoretical framework for these methods. We propose a unified algorithm for NMF and provide a rigorous proof of monotonicity of multiplicative updates for W and H. In addition, we generalize the relationship between NMF and PLSI within this framework. We demonstrate the applicability and utility of our approach as well as its superior performance relative to existing methods using real-life and simulated document clustering data.

Non-Negative Matrix Factorization For Filtering Chinese And Oriental Language Document

Non-Negative Matrix Factorization For Filtering Chinese Document

Document Clustering Using Locality Preserving Indexing

Nonnegative Matrix Factorization on Orthogonal Subspace

Document Clustering Based on Spectral Clustering and Non-negative Matrix Factorization

Non-negative Matrix-Set Factorization

Robust discriminative non-negative matrix factorization.

A unified statistical approach to non-negative matrix factorization and probabilistic latent semantic indexing

Locality Preserving Nonnegative Matrix Factorization.

Dimensionality Reduction With Category Information Fusion And Non-Negative Matrix Factorization For Text Categorization

Analysis of Legal Documents via Non-negative Matrix Factorization Methods

A constrained non-negative matrix factorization in information retrieval

Guided Semi-Supervised Non-negative Matrix Factorization on Legal Documents

Robust Structured Nonnegative Matrix Factorization for Image Representation.

Ensemble Non-negative Matrix Factorization for Clustering Biomedical Documents

Nonnegative Matrix Factorization for Multimodality Data from Multi-source Domain

Non-Negative Matrix Factorization with Constraints.

Local Linear Matrix Factorization for Document Modeling

General Subspace Constrained Non-Negative Matrix Factorization for Data Representation

Non-Negative Sparse Semantic Coding for Text Categorization

Generating Different Semantic Spaces For Document Classification