Abstract:Graph regularized non-negative matrix factorization (NMF) algorithms can be applied to information retrieval, image processing, and pattern recognition. However, challenge that still remains is to prove the convergence of this class of learning algorithms since the geometrical structure of the data space is considered. This paper presents the convergence properties of the graph regularized NMF learning algorithms. In the analysis, we focus on the study of Euclidian distance based algorithms. The structures of the fixed points are presented. The non-divergence of the learning algorithms is analyzed by constructing invariant sets for update rules. Based on Lyapunov indirect method, the stability of the algorithms is discussed in detail. The analysis shows that this class of NMF algorithms can converge to their fixed points under some given conditions. In the simulations, theoretical results presented in the paper are confirmed. For different initializations and data sets, variations of cost functions and decomposition data in the learning are presented to show the convergence features of the discussed NMF update rules, and the convergence speed of the algorithms is also investigated.

Convergence Analysis of Projective Neural Networks Based on Partial Matrix

Convergence Analysis of General Neural Networks under Almost Periodic Stimuli

Convergence Analysis of Projected Gradient Descent for Schatten-p Nonconvex Matrix Recovery

A Critical Global Convergence Analysis of Recurrent Neural Networks with General Projection Mappings

New Critical Analysis on Global Convergence of Recurrent Neural Networks with Projection Mappings

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

Exponential Stability of Projected Neural Networks System with the Delay

A New Neural Network Model And Its Application

A New Lmi-Based Approach For Stability Analysis Of Cellular Neural Networks With Time Delay

A generalized global convergence theory of projection-type neural networks for optimization

Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization

Convergence Theory For Unified Discrete-Time Rnns With Quasi-Symmetric Connection

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

On the P-critical dynamics analysis of projection recurrent neural networks

Stability Analysis of Recurrent Multilayer Perceptrons:Lmi Approach

New Approach for Robust Stability Analysis of Delayed Recurrent Neural Networks

CONVERGENCE ANALYSIS OF DISCRETE-TIME NEURAL NETWORK FOR SOLVING QUADRATIC PROGRAMMING PROBLEMS

On exponential convergence conditions of an extended projection neural network

Stability analysis of a class of discrete-time recurrent neural networks: An LMI approach

On convergence of a sketch-and-project method for the matrix equation

Stability Analysis on a Class of Nonlinear Continuous Neural Networks