Abstract:Principal component analysis (PCA) and minor component analysis (MCA) are two important statistical tools which have many applications in the fields of signal processing and data analysis. PCA and MCA neural networks (NNs) can be used to online extract principal component and minor component from input data. It is interesting to develop generalized learning algorithms of PCA and MCA NNs. Some novel generalized PCA and MCA learning algorithms are proposed in this paper. Convergence of PCA and MCA learning algorithms is an essential issue in practical applications. Traditionally, the convergence is studied via deterministic continuous-time (DCT) method. The DCT method requires the learning rate of the algorithms to approach to zero, which is not realistic in many practical applications. In this paper, deterministic discrete-time (DDT) method is used to study the dynamical behaviors of the proposed algorithms. The DDT method is more reasonable for the convergence analysis since it does not require constraints as that of the DCT method. It is proven that under some mild conditions, the weight vector in these proposed algorithms will converge exponentially to principal or minor component. Simulation results are further used to illustrate the theoretical results.

Global Convergence of an Adaptive Minor Component Extraction Algorithm

Convergence analysis of a simple minor component analysis algorithm.

A neural networks learning algorithm for minor component analysis and its convergence analysis

A Globally Convergent MC Algorithm With an Adaptive Learning Rate.

A New Algorithm for Sequential Minor Component Analysis

Convergence Analysis of a Deterministic Discrete Time System of Feng's MCA Learning Algorithm

A modified MCA EXIN algorithm and its convergence analysis

A stable MCA learning algorithm

Global Convergence Analysis of a Self-Stabilizing MCA Learning Algorithm.

Convergence Analysis of the OJAn MCA Learning Algorithm by the Deterministic Discrete Time Method

Dynamics of Generalized PCA and MCA Learning Algorithms.

On the Discrete-Time Dynamics of a Class of Self-Stabilizing MCA Extraction Algorithms

On the Discrete Time Dynamics of the MCA Neural Networks

An Improved Minor Component Analysis Algorithm Based on Convergence Analysis of 5G Multi-Dimensional Signals.

Convergence analysis of deterministic discrete time system of a unified self-stabilizing algorithm for PCA and MCA.

A unified learning algorithm to extract principal and minor components

On the Discrete Time Dynamics of a Self-Stabilizing MCA Learning Algorithm.

Convergence Analysis of Adaptive Total Least Square Based on Deterministic Discrete Time

A Globally Convergent MCA Algorithm by Generalized Eigen-Decomposition.

Global convergence analysis of a PCA learning algorithm

A Modified Oja–Xu MCA Learning Algorithm and Its Convergence Analysis