Abstract:Principal component analysis (PCA) and minor component analysis (MCA) are two important statistical tools which have many applications in the fields of signal processing and data analysis. PCA and MCA neural networks (NNs) can be used to online extract principal component and minor component from input data. It is interesting to develop generalized learning algorithms of PCA and MCA NNs. Some novel generalized PCA and MCA learning algorithms are proposed in this paper. Convergence of PCA and MCA learning algorithms is an essential issue in practical applications. Traditionally, the convergence is studied via deterministic continuous-time (DCT) method. The DCT method requires the learning rate of the algorithms to approach to zero, which is not realistic in many practical applications. In this paper, deterministic discrete-time (DDT) method is used to study the dynamical behaviors of the proposed algorithms. The DDT method is more reasonable for the convergence analysis since it does not require constraints as that of the DCT method. It is proven that under some mild conditions, the weight vector in these proposed algorithms will converge exponentially to principal or minor component. Simulation results are further used to illustrate the theoretical results.

Convergence analysis of a simple minor component analysis algorithm.

Global Convergence of an Adaptive Minor Component Extraction Algorithm

A New Algorithm for Sequential Minor Component Analysis

A neural networks learning algorithm for minor component analysis and its convergence analysis

Convergence Analysis of the OJAn MCA Learning Algorithm by the Deterministic Discrete Time Method

Convergence Analysis of a Deterministic Discrete Time System of Feng's MCA Learning Algorithm

On the Discrete-Time Dynamics of a Class of Self-Stabilizing MCA Extraction Algorithms

A stable MCA learning algorithm

On the Discrete Time Dynamics of a Self-Stabilizing MCA Learning Algorithm.

Convergence analysis of deterministic discrete time system of a unified self-stabilizing algorithm for PCA and MCA.

An Improved Minor Component Analysis Algorithm Based on Convergence Analysis of 5G Multi-Dimensional Signals.

Dynamics of Generalized PCA and MCA Learning Algorithms.

A modified MCA EXIN algorithm and its convergence analysis

A unified learning algorithm to extract principal and minor components

A Modified Oja–Xu MCA Learning Algorithm and Its Convergence Analysis

Chaos Control with STM of Minor Component Analysis Learning Algorithm

Convergence Analysis for Oja+ MCA Learning Algorithm

Global Convergence Analysis of a Self-Stabilizing MCA Learning Algorithm.

A Class of Learning Algorithms for Principal Component Analysis and Minor Component Analysis

On the Discrete Time Dynamics of the MCA Neural Networks

A Globally Convergent MCA Algorithm by Generalized Eigen-Decomposition.