Abstract:Nonnegative matrix factorization (NMF) is a powerful matrix decomposition technique that approximates a nonnegative matrix by the product of two low-rank nonnegative matrix factors. It has been widely applied to signal processing, computer vision, and data mining. Traditional NMF solvers include the multiplicative update rule (MUR), the projected gradient method (PG), the projected nonnegative least squares (PNLS), and the active set method (AS). However, they suffer from one or some of the following three problems: slow convergence rate, numerical instability and nonconvergence. In this paper, we present a new efficient NeNMF solver to simultaneously overcome the aforementioned problems. It applies Nesterov's optimal gradient method to alternatively optimize one factor with another fixed. In particular, at each iteration round, the matrix factor is updated by using the PG method performed on a smartly chosen search point, where the step size is determined by the Lipschitz constant. Since NeNMF does not use the time consuming line search and converges optimally at rate O(1/k(2)) in optimizing each matrix factor, it is superior to MUR and PG in terms of efficiency as well as approximation accuracy. Compared to PNLS and AS that suffer from numerical instability problem in the worst case, NeNMF overcomes this deficiency. In addition, NeNMF can be used to solve L-1-norm, L-2-norm and manifold regularized NMF with the optimal convergence rate. Numerical experiments on both synthetic and real-world datasets show the efficiency of NeNMF for NMF and its variants comparing to representative NMF solvers. Extensive experiments on document clustering suggest the effectiveness of NeNMF.

A Bregman Proximal ADMM for NMF with Outliers: Estimating features with missing values and outliers: a Bregman-proximal point algorithm for robust Non-negative Matrix Factorization with application to gene expression analysis

Robust discriminative non-negative matrix factorization.

Sparse Nonnegative Matrix Factorization with Genetic Algorithms for Microarray Analysis

Optimization and expansion of non-negative matrix factorization

Sparse nonnegative matrix factorization applied to microarray data sets

Efficient algorithms for regularized Poisson Non-negative Matrix Factorization

Blind Matrix Decomposition Via Genetic Optimization Of Sparseness And Nonnegativity Constraints

Distributionally Robust and Multi-Objective Nonnegative Matrix Factorization

Robust Semi-nonnegative Matrix Factorization with Adaptive Graph Regularization for Gene Representation

Majorization-minimization Bregman proximal gradient algorithms for nonnegative matrix factorization with the Kullback--Leibler divergence

Bayesian non-negative matrix factorization with Student's t-distribution for outlier removal and data clustering

Sparse Orthogonal Nonnegative Matrix Factorization for Identifying Differentially Expressed Genes and Clustering Tumor Samples.

NeNMF: an Optimal Gradient Method for Nonnegative Matrix Factorization.

An Efficient Nonmonotone Projected Barzilai–Borwein Method for Nonnegative Matrix Factorization with Extrapolation

Hybridizing Sparse Component Analysis with Genetic Algorithms for Microarray Analysis.

Robust hypergraph regularized non-negative matrix factorization for sample clustering and feature selection in multi-view gene expression data

Robust Bayesian Nonnegative Matrix Factorization with Implicit Regularizers

Nonnegative Matrix Factorization on Orthogonal Subspace

Imputation and low-rank estimation with Missing Not At Random data

Orthogonal Nonnegative Matrix Factorization with the Kullback-Leibler divergence

Regularized Non-Negative Matrix Factorization for Identifying Differentially Expressed Genes and Clustering Samples: A Survey.