Abstract:Dimension reduction is a challenge task in data processing, especially in high-dimensional data processing area. Non-negative matrix factorization (NMF), as a classical dimension reduction method, has a contribution to the parts-based representation for the characteristics of non-negative constraints in the NMF algorithm. In this paper, the NMF algorithm is introduced to extract local features for dimension reduction. Considering the problem of which NMF is required to define the number of the decomposition rank manually, we proposed a rank-adaptive NMF algorithm, in which the affinity propagation (AP) clustering algorithm is introduced to determine adaptively the number of the decomposition rank of NMF. Then, the rank-adaptive NMF algorithm is used to extract features for the original image. After that, a low-dimensional representation of the original image is obtained through the projection from the original images to the feature space. Finally, we used extreme learning machine (ELM) and k-nearest neighbor (KNN) as the classifier to classify those low-dimensional feature representations. The experimental results demonstrate that the decomposition rank determined by the AP clustering algorithm can reflect the characteristics of the original data. When it is combined with the classification algorithm ELM or KNN and applied to handwritten character recognition, the proposed method not only reduces the dimension of original images but also performs well in terms of classification accuracy and time consumption. A new rank-adaptive NMF algorithm is proposed based on the AP clustering algorithm and the original NMF algorithm. According to this algorithm, the low-dimensional representation of the original data can be obtained without any prior knowledge. In addition, the proposed rank-adaptive NMF algorithm combined with the ELM and KNN classification algorithms performs well.

Decentralized Rank-Adaptive Matrix Factorization—Part II: Convergence Analysis

Decentralized Rank-Adaptive Matrix Factorization — Part I: Algorithm Development

Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization

In-depth Analysis of Low-rank Matrix Factorisation in a Federated Setting

Finite-Time Convergence Rates of Decentralized Local Markovian Stochastic Approximation

Rank-Adaptive Non-Negative Matrix Factorization

Notes on Low-rank Matrix Factorization

Nonconvex ADMM for Rank-Constrained Matrix Sensing Problem

Alternating Mixing Stochastic Gradient Descent for Large-scale Matrix Factorization

A Multilayered-and-Randomized Latent Factor Model for High-Dimensional and Sparse Matrices

Accelerating Ill-Conditioned Low-Rank Matrix Estimation via Scaled Gradient Descent

Distributed Low-rank Matrix Factorization with Exact Consensus

Exact Linear Convergence Rate Analysis for Low-Rank Symmetric Matrix Completion via Gradient Descent

Adaptive Rank-One Matrix Completion using Sum of Outer Products

Preconditioning Matters: Fast Global Convergence of Non-convex Matrix Factorization via Scaled Gradient Descent

Generalized Nonconvex Nonsmooth Low-Rank Matrix Recovery Framework with Feasible Algorithm Designs and Convergence Analysis.

Beyond Low Rank: A Data-Adaptive Tensor Completion Method

On the analysis of optimization with fixed-rank matrices: a quotient geometric view

Distributed Stochastic ADMM for Matrix Factorization.

Projected Gradient Descent Algorithm for Low-Rank Matrix Estimation

On the Global Convergence of the Alternating Least Squares Method for Rank-One Approximation to Generic Tensors