Abstract:<p>The main issue in incremental nonnegative matrix factorization(INMF) is how to update base matrix and coefficient matrix. The re-training scheme(RT-NMF) and the scheme proposed by Bucak and Gunsel(BG-INMF) are two common methods. However, both of them have problems in balancing root mean square error(RMSE) and time cost when incremental samples appear in a batch form. In this paper, a three-stage method(3S-INMF) is proposed to derive a good balance between RMSE and time cost. In the first stage, only the coefficient matrix of incremental samples is updated while the base matrix and the coefficient matrix of old samples are fixed. If the RMSE does not meet the required precision after this stage, the second stage, i.e. BG-INMF, is carried out. In the second stage, the base matrix and the coefficient matrix of incremental samples are updated alternatively while the coefficient matrix of old samples is fixed. If the RMSE still does not meet with the required precision after BG-INMF, the coefficient matrix of old samples will be updated in the third stage while the base matrix and the coefficient matrix of incremental samples are fixed. In the three consecutive stages, the initial values of base matrix and coefficient matrix in each stage are the corresponding output values in the previous stage. In addition, extensive experiments on the three popular datasets show that 3S-INMF obtains the best balance between RMSE and time cost compared with RT-NMF and BG-INMF. Furthermore, the 3S-INMF is extended to graph nonnegative matrix factorization(GNMF) and kernel nonnegative matrix factorization(KNMF), which also has a superior performance examined by further experiments.</p>

DID: Distributed Incremental Block Coordinate Descent for Nonnegative Matrix Factorization

Coordinate Descent Methods for Symmetric Nonnegative Matrix Factorization

A High-Performance Parallel Algorithm for Nonnegative Matrix Factorization

Inexact Block Coordinate Descent Methods for Symmetric Nonnegative Matrix Factorization

Incremental Nonnegative Matrix Factorization with Sparseness Constraint for Image Representation.

Discriminative Concept Factorization for Data Representation

A Fast Algorithm for Nonnegative Matrix Factorization and Its Convergence.

Incremental Nonnegative Matrix Factorization for Face Recognition

Normalized Dimensionality Reduction Using Nonnegative Matrix Factorization

Spatially correlated nonnegative matrix factorization

A Block Coordinate Descent-Based Projected Gradient Algorithm for Orthogonal Non-Negative Matrix Factorization

Locality Preserving Nonnegative Matrix Factorization.

Fast Parallel Randomized Algorithm for Nonnegative Matrix Factorization with KL Divergence for Large Sparse Datasets

Distributed Graph Regularized Non-Negative Matrix Factorization with Greedy Coordinate Descent.

A survey on algorithms of incremental non-negative matrix factorization

Unified Solution to Nonnegative Data Factorization Problems

Recovering Hidden Diagonal Structures Via Non-Negative Matrix Factorization with Multiple Constraints

Nonnegative Discriminant Matrix Factorization

A three-stage method for batch-based incremental nonnegative matrix factorization

Accelerated Algorithm to Incomplete Nonnegative Matrix Factorization

Evolutionary Nonnegative Matrix Factorization with Adaptive Control of Cluster Quality.