Abstract:Non-negative matrix factorization (NMF), a method for finding parts-based representation of non-negative data, has shown remarkable competitiveness in data analysis. Given that real-world datasets are often comprised of multiple features or views which describe data from various perspectives, it is important to exploit diversity from multiple views for comprehensive and accurate data representations. Moreover, real-world datasets often come with high-dimensional features, which demands the efficiency of low-dimensional representation learning approaches. To address these needs, we propose a diverse NMF (DiNMF) approach. It enhances the diversity, reduces the redundancy among multiview representations with a novel defined diversity term and enables the learning process in linear execution time. We further propose a locality preserved DiNMF (LP-DiNMF) for more accurate learning, which ensures diversity from multiple views while preserving the local geometry structure of data in each view. Efficient iterative updating algorithms are derived for both DiNMF and LP-DiNMF, along with proofs of convergence. Experiments on synthetic and real-world datasets have demonstrated the efficiency and accuracy of the proposed methods against the state-of-the-art approaches, proving the advantages of incorporating the proposed diversity term into NMF.

Divergence Functions of Non Negative Matrix Factorization: A Comparison Study.

On -Divergence Based Nonnegative Matrix Factorization for Clustering Cancer Gene Expression Data

Non-negative matrix factorization with α-divergence

Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization

Nonnegative Matrix Factorization: Models, Algorithms And Applications

Survey on the Variations and Applications of Nonnegative Matrix Factorization

Selecting Β-Divergence for Nonnegative Matrix Factorization by Score Matching

Deep Nonnegative Matrix Factorization with Beta Divergences

On α-divergence based nonnegative matrix factorization for clustering cancer gene expression data

A statistical framework for non-negative matrix factorization based on generalized dual divergence

Non-negative Matrix Factorization: A Survey.

Convergent Projective Non-Negative Matrix Factorization with Kullback-Leibler Divergence

Regularized Non-Negative Matrix Factorization for Identifying Differentially Expressed Genes and Clustering Samples: A Survey.

Intrusion detection method based on non-negative matrix factorization with alpha divergence

Online Blind Separation of Dependent Sources Using Nonnegative Matrix Factorization Based on Kl Divergence

Automatic Relevance Determination in Nonnegative Matrix Factorization with the β-Divergence

Diverse Non-Negative Matrix Factorization for Multiview Data Representation.

Fast Parallel Randomized Algorithm for Nonnegative Matrix Factorization with KL Divergence for Large Sparse Datasets

Nonnegative Discriminant Matrix Factorization

Non-negative Matrix Factorization: A Short Survey on Methods and Applications

Modified Subspace Barzilai-Borwein Gradient Method for Non-Negative Matrix Factorization