Abstract:Nonnegative matrix factorization (NMF) is a powerful matrix decomposition technique that approximates a nonnegative matrix by the product of two low-rank nonnegative matrix factors. It has been widely applied to signal processing, computer vision, and data mining. Traditional NMF solvers include the multiplicative update rule (MUR), the projected gradient method (PG), the projected nonnegative least squares (PNLS), and the active set method (AS). However, they suffer from one or some of the following three problems: slow convergence rate, numerical instability and nonconvergence. In this paper, we present a new efficient NeNMF solver to simultaneously overcome the aforementioned problems. It applies Nesterov's optimal gradient method to alternatively optimize one factor with another fixed. In particular, at each iteration round, the matrix factor is updated by using the PG method performed on a smartly chosen search point, where the step size is determined by the Lipschitz constant. Since NeNMF does not use the time consuming line search and converges optimally at rate O(1/k(2)) in optimizing each matrix factor, it is superior to MUR and PG in terms of efficiency as well as approximation accuracy. Compared to PNLS and AS that suffer from numerical instability problem in the worst case, NeNMF overcomes this deficiency. In addition, NeNMF can be used to solve L-1-norm, L-2-norm and manifold regularized NMF with the optimal convergence rate. Numerical experiments on both synthetic and real-world datasets show the efficiency of NeNMF for NMF and its variants comparing to representative NMF solvers. Extensive experiments on document clustering suggest the effectiveness of NeNMF.

Nonsmooth Nonnegative Matrix Factorization Algorithm Based on Particle Swarm Optimization

Unsupervised Hyperspectral Unmixing Based on Constrained Nonnegative Matrix Factorization and Particle Swarm Optimization

Constrained Nonnegative Matrix Factorization Based on Particle Swarm Optimization for Hyperspectral Unmixing

Band Selection for Hyperspecral Imagery Based on Particle Swarm Optimization

A New Scheme for Decomposition of Mixed Pixels Based on Modified Nonnegative Matrix Factorization and Genetic-Algorithm

Nonnegative matrix factorization with piecewise smoothness constraint for hyperspectral unmixing

[A method of endmember extraction in hyperspectral remote sensing images based on discrete particle swarm optimization (D-PSO)]

Minimum Variance Block-Based Nonnegative Matrix Factorization Algorithm for Hyperspectral Unmixing.

Spectral–Spatial Robust Nonnegative Matrix Factorization for Hyperspectral Unmixing

Hyperspectral Unmixing Using Robust Deep Nonnegative Matrix Factorization

Nonlocal Low-Rank Nonnegative Tensor Factorization for Hyperspectral Unmixing

Nonnegative Matrix Factorization on Orthogonal Subspace

A Complexity Constrained Nonnegative Matrix Factorization for Hyperspectral Unmixing

Nonnegative-Matrix-Factorization-Based Hyperspectral Unmixing with Partially Known Endmembers

Group Sparse Nonnegative Matrix Factorization for Hyperspectral Image Denoising

Nonnegative Matrix Factorization with Data-Guided Constraints for Hyperspectral Unmixing.

A Particle Swarm Optimization Method Applied to Global Optimization of Inverse Problem

Non-negative Matrix-Set Factorization

A robust-oriented Particle Swarm Optimization algorithm for inverse problems

Swarm Intelligence For Non-Negative Matrix Factorization

NeNMF: an Optimal Gradient Method for Nonnegative Matrix Factorization.