Abstract:Binary data matrices can represent many types of data such as social networks, votes, or gene expression. In some cases, the analysis of binary matrices can be tackled with nonnegative matrix factorization (NMF), where the observed data matrix is approximated by the product of two smaller nonnegative matrices. In this context, probabilistic NMF assumes a generative model where the data is usually Bernoulli-distributed. Often, a link function is used to map the factorization to the [0, 1] range, ensuring a valid Bernoulli mean parameter. However, link functions have the potential disadvantage to lead to uninterpretable models. Mean-parameterized NMF, on the contrary, overcomes this problem. We propose a unified framework for Bayesian mean-parameterized nonnegative binary matrix factorization models (NBMF). We analyze three models which correspond to three possible constraints that respect the mean-parameterization without the need for link functions. Furthermore, we derive a novel collapsed Gibbs sampler and a collapsed variational algorithm to infer the posterior distribution of the factors. Next, we extend the proposed models to a nonparametric setting where the number of used latent dimensions is automatically driven by the observed data. We analyze the performance of our NBMF methods in multiple datasets for different tasks such as dictionary learning and prediction of missing data. Experiments show that our methods provide similar or superior results than the state of the art, while automatically detecting the number of relevant components.

Bayesian Nonnegative Matrix Factorization with a Truncated Spike-and-Slab Prior

Block-Sparse Signal Recovery Based on Adaptive Matching Pursuit Via Spike and Slab Prior

Nonparametric Bayesian Nonnegative Matrix Factorization

Diversified Bayesian Nonnegative Matrix Factorization

Robust Bayesian Nonnegative Matrix Factorization with Implicit Regularizers

Bayesian Nonnegative Matrix Factorization with Dirichlet Process Mixtures

Bayesian mean-parameterized nonnegative binary matrix factorization

A Discrete-Time Neurodynamic Approach to Sparsity-Constrained Nonnegative Matrix Factorization

Extended sparse nonnegative matrix factorization

Linear Projection-based Non-negative Matrix Factorization

Sparse nonnegative matrix factorization applied to microarray data sets

Bayesian non-negative matrix factorization with Student's t-distribution for outlier removal and data clustering

Factor-Bounded Nonnegative Matrix Factorization

Log-based Sparse Nonnegative Matrix Factorization for Data Representation

Graph regularized non-negative matrix factorization with sparse coding

A locally weighted sparse graph regularized Non-Negative Matrix Factorization method.

Bayesian singular value regularization via a cumulative shrinkage process

Disjunct Support Spike and Slab Priors for Variable Selection in Regression under Quasi-sparseness

Non-negative and Sparse Spectral Clustering

Cauchy balanced nonnegative matrix factorization

Truncated Cauchy Non-Negative Matrix Factorization.