Abstract:Matrix decomposition is ubiquitous and has applications in various fields like speech processing, data mining and image processing to name a few. Under matrix decomposition, nonnegative matrix factorization is used to decompose a nonnegative matrix into a product of two nonnegative matrices which gives some meaningful interpretation of the data. Thus, nonnegative matrix factorization has an edge over the other decomposition techniques. In this paper, we propose two novel iterative algorithms based on Majorization Minimization (MM)-in which we formulate a novel upper bound and minimize it to get a closed form solution at every iteration. Since the algorithms are based on MM, it is ensured that the proposed methods will be monotonic. The proposed algorithms differ in the updating approach of the two nonnegative matrices. The first algorithm-Iterative Nonnegative Matrix Factorization (INOM) sequentially updates the two nonnegative matrices while the second algorithm-Parallel Iterative Nonnegative Matrix Factorization (PARINOM) parallely updates them. We also prove that the proposed algorithms converge to the stationary point of the problem. Simulations were conducted to compare the proposed methods with the existing ones and was found that the proposed algorithms performs better than the existing ones in terms of computational speed and convergence. KeyWords: Nonnegative matrix factorization, Majorization Minimization, Big Data, Parallel, Multiplicative Update

Convex Algorithms for Nonnegative Matrix Factorization

Convex and semi-nonnegative matrix factorizations

A Fast Algorithm for Nonnegative Matrix Factorization and Its Convergence.

An Alternating Direction Algorithm for Matrix Completion with Nonnegative Factors

Nonconvex Optimization Meets Low-Rank Matrix Factorization: An Overview

A Convergent Algorithm for Bi-orthogonal Nonnegative Matrix Tri-Factorization

A convex model for nonnegative matrix factorization and dimensionality reduction on physical space

Nonnegative Tensor Factorizations Using an Alternating Direction Method

Unified Solution to Nonnegative Data Factorization Problems

A Symmetric Rank-one Quasi Newton Method for Non-negative Matrix Factorization

Novel Algorithms based on Majorization Minimization for Nonnegative Matrix Factorization

Nonnegative Low Rank Matrix Approximation for Nonnegative Matrices

An Efficient Monotone Projected Barzilai–Borwein Method for Nonnegative Matrix Factorization

Non-negative matrix factorization and deconvolution as dual simplex problem

A Gradient-Based Algorithm with Nonmonotone Line Search for Nonnegative Matrix Factorization

Constraint-Relaxation Approach for Nonnegative Matrix Factorization: A Case Study

Factor-Bounded Nonnegative Matrix Factorization

Non-negative tensor factorization with applications to statistics and computer vision

A Sparse Algorithm for Non-Negative Matrix Factorization Based on Projection Gradient Method

Approximation Algorithms for Orthogonal Non-negative Matrix Factorization

Randomized Algorithms for Symmetric Nonnegative Matrix Factorization