Abstract:Principal component analysis (PCA) and minor component analysis (MCA) are two important statistical tools which have many applications in the fields of signal processing and data analysis. PCA and MCA neural networks (NNs) can be used to online extract principal component and minor component from input data. It is interesting to develop generalized learning algorithms of PCA and MCA NNs. Some novel generalized PCA and MCA learning algorithms are proposed in this paper. Convergence of PCA and MCA learning algorithms is an essential issue in practical applications. Traditionally, the convergence is studied via deterministic continuous-time (DCT) method. The DCT method requires the learning rate of the algorithms to approach to zero, which is not realistic in many practical applications. In this paper, deterministic discrete-time (DDT) method is used to study the dynamical behaviors of the proposed algorithms. The DDT method is more reasonable for the convergence analysis since it does not require constraints as that of the DCT method. It is proven that under some mild conditions, the weight vector in these proposed algorithms will converge exponentially to principal or minor component. Simulation results are further used to illustrate the theoretical results.

A modified MCA EXIN algorithm and its convergence analysis

A neural networks learning algorithm for minor component analysis and its convergence analysis

Convergence analysis of a simple minor component analysis algorithm.

Global Convergence of an Adaptive Minor Component Extraction Algorithm

A Modified Oja–Xu MCA Learning Algorithm and Its Convergence Analysis

A Globally Convergent MCA Algorithm by Generalized Eigen-Decomposition.

A stable MCA learning algorithm

A New Algorithm for Sequential Minor Component Analysis

An Improved Minor Component Analysis Algorithm Based on Convergence Analysis of 5G Multi-Dimensional Signals.

Global Convergence Analysis of a Self-Stabilizing MCA Learning Algorithm.

Convergence Analysis of the OJAn MCA Learning Algorithm by the Deterministic Discrete Time Method

Dynamics of Generalized PCA and MCA Learning Algorithms.

On the Discrete Time Dynamics of the MCA Neural Networks

On the Discrete-Time Dynamics of a Class of Self-Stabilizing MCA Extraction Algorithms

A Globally Convergent MC Algorithm With an Adaptive Learning Rate.

A class of self-stabilizing MCA learning algorithms.

Convergence analysis of deterministic discrete time system of a unified self-stabilizing algorithm for PCA and MCA.

A unified learning algorithm to extract principal and minor components

Convergence Analysis of a Deterministic Discrete Time System of Feng's MCA Learning Algorithm

Adaptive Minor Component Extraction with Modular Structure

Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization