Abstract:Nonnegative Matrix Factorization (NMF) aims to factorize a matrix into two optimized nonnegative matrices appropriate for the intended applications. The method has been widely used for unsupervised learning tasks, including recommender systems (rating matrix of users by items) and document clustering (weighting matrix of papers by keywords). However, traditional NMF methods typically assume the number of latent factors (i.e., dimensionality of the loading matrices) to be fixed. This assumption makes them inflexible for many applications. In this paper, we propose a nonparametric NMF framework to mitigate this issue by using dependent Indian Buffet Processes (dIBP). In a nutshell, we apply a correlation function for the generation of two stick weights associated with each pair of columns of loading matrices, while still maintaining their respective marginal distribution specified by IBP. As a consequence, the generation of two loading matrices will be column-wise (indirectly) correlated. Under this same framework, two classes of correlation function are proposed (1) using Bivariate beta distribution and (2) using Copula function. Both methods allow us to adopt our work for various applications by flexibly choosing an appropriate parameter settings. Compared with the other state-of-the art approaches in this area, such as using Gaussian Process (GP)-based dIBP, our work is seen to be much more flexible in terms of allowing the two corresponding binary matrix columns to have greater variations in their non-zero entries. Our experiments on the real-world and synthetic datasets show that three proposed models perform well on the document clustering task comparing standard NMF without predefining the dimension for the factor matrices, and the Bivariate beta distribution-based and Copula-based models have better flexibility than the GP-based model.

Indian Buffet Process-Based on Nonnegative Matrix Factorization with Single Binary Component.

Dependent Indian Buffet Process-based Sparse Nonparametric Nonnegative Matrix Factorization

The convergent Indian buffet process

Diversified Bayesian Nonnegative Matrix Factorization

Poisson Latent Feature Calculus for Generalized Indian Buffet Processes

Allowing Growing Dimensional Binary Outcomes via the Multivariate Probit Indian Buffet Process

Indian Buffet process factor model for counterfactual analysis

Discriminative Concept Factorization for Data Representation

Minimum Variance Block-Based Nonnegative Matrix Factorization Algorithm for Hyperspectral Unmixing.

Binary Matrix Factorisation via Column Generation

Bayesian mean-parameterized nonnegative binary matrix factorization

Modeling user and item biases with Gaussian distribution for collaborative filtering

Deep Functional Factor Models: Forecasting High-Dimensional Functional Time Series via Bayesian Nonparametric Factorization

Bayesian Analysis of Generalized Hierarchical Indian Buffet Processes for Within and Across Group Sharing of Latent Features

Nonparametric Bayesian Negative Binomial Factor Analysis

A Majorization-Minimization Algorithm for Nonnegative Binary Matrix Factorization

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Factor-Bounded Nonnegative Matrix Factorization

Posterior Contraction Rate of Sparse Latent Feature Models with Application to Proteomics

Binary matrix factorization via collaborative neurodynamic optimization

Comparative Study of Inference Methods for Bayesian Nonnegative Matrix Factorisation