Abstract:Principal component analysis (PCA) and minor component analysis (MCA) are two important statistical tools which have many applications in the fields of signal processing and data analysis. PCA and MCA neural networks (NNs) can be used to online extract principal component and minor component from input data. It is interesting to develop generalized learning algorithms of PCA and MCA NNs. Some novel generalized PCA and MCA learning algorithms are proposed in this paper. Convergence of PCA and MCA learning algorithms is an essential issue in practical applications. Traditionally, the convergence is studied via deterministic continuous-time (DCT) method. The DCT method requires the learning rate of the algorithms to approach to zero, which is not realistic in many practical applications. In this paper, deterministic discrete-time (DDT) method is used to study the dynamical behaviors of the proposed algorithms. The DDT method is more reasonable for the convergence analysis since it does not require constraints as that of the DCT method. It is proven that under some mild conditions, the weight vector in these proposed algorithms will converge exponentially to principal or minor component. Simulation results are further used to illustrate the theoretical results.

A Globally Convergent MC Algorithm With an Adaptive Learning Rate.

Global Convergence of an Adaptive Minor Component Extraction Algorithm

Global Convergence Analysis of a Self-Stabilizing MCA Learning Algorithm.

Global convergence analysis of a PCA learning algorithm

A Globally Convergent MCA Algorithm by Generalized Eigen-Decomposition.

A stable MCA learning algorithm

A neural networks learning algorithm for minor component analysis and its convergence analysis

A Globally Convergent Learning Algorithm for Pca Neural Networks

A Robust And Globally Convergent Pca Learning Algorithm

Convergence analysis of a simple minor component analysis algorithm.

Dynamics of Generalized PCA and MCA Learning Algorithms.

Robust beamforming by a globally convergent MCA neural network

Global Convergence of GHA Learning Algorithm with Nonzero-Approaching Adaptive Learning Rates

A modified MCA EXIN algorithm and its convergence analysis

A class of self-stabilizing MCA learning algorithms.

On the Discrete Time Dynamics of the MCA Neural Networks

Convergence Analysis of the OJAn MCA Learning Algorithm by the Deterministic Discrete Time Method

Global Convergence of a PCA Learning Algorithm with a Constant Learning Rate

Convergence Analysis of a Deterministic Discrete Time System of Feng's MCA Learning Algorithm

An Improved Minor Component Analysis Algorithm Based on Convergence Analysis of 5G Multi-Dimensional Signals.

A unified learning algorithm to extract principal and minor components