Abstract:Nonnegative matrix factorization (NMF) based topic modeling methods do not rely on model- or data-assumptions much. However, they are usually formulated as difficult optimization problems, which may suffer from bad local minima and high computational complexity. In this paper, we propose a deep NMF (DNMF) topic modeling framework to alleviate the aforementioned problems. It first applies an unsupervised deep learning method to learn latent hierarchical structures of documents, under the assumption that if we could learn a good representation of documents by, e.g. a deep model, then the topic word discovery problem can be boosted. Then, it takes the output of the deep model to constrain a topic-document distribution for the discovery of the discriminant topic words, which not only improves the efficacy but also reduces the computational complexity over conventional unsupervised NMF methods. We constrain the topic-document distribution in three ways, which takes the advantages of the three major sub-categories of NMF—basic NMF, structured NMF, and constrained NMF respectively. To overcome the weaknesses of deep neural networks in unsupervised topic modeling, we adopt a non-neural-network deep model—multilayer bootstrap network. To our knowledge, this is the first time that a deep NMF model is used for unsupervised topic modeling. We have compared the proposed method with a number of representative references covering major branches of topic modeling on a variety of real-world text corpora. Experimental results illustrate the effectiveness of the proposed method under various evaluation metrics.

Topic Classification of Chinese Document Based on NMF

Non-Negative Matrix Factorization For Filtering Chinese Document

Document Clustering Based on Non-Negative Matrix Factorization

Non-Negative Matrix Factorization For Filtering Chinese And Oriental Language Document

A diversifying hidden units method based on NMF for document representation

Guided Semi-Supervised Non-negative Matrix Factorization on Legal Documents

Document clustering based on nonnegative sparse matrix factorization

Chinese Documents Categorization Based on N-gram Information

Generating Different Semantic Spaces For Document Classification

Topic Change Detection Method Based on Joint Nonnegative Matrix Factorization

Chinese Documents Classification Based on N-Grams

Chinese semantic document classification based on strategies of semantic similarity computation and correlation analysis

Analysis of Legal Documents via Non-negative Matrix Factorization Methods

Deep NMF topic modeling

Document Clustering Based on Spectral Clustering and Non-negative Matrix Factorization

Chinese Document Categorization without Dictionary Support and Segmentation Processing

Hierarchical Classification of Chinese Documents Based on N-grams

Performance Comparison of TF*IDF, LDA and Paragraph Vector for Document Classification

Classifying web documents using term spectral transforms and Multi-Dimensional Latent Semantic representation

Document Classification Based on Word Vectors

Hierarchical classification of Chinese documents based onN-grams