Abstract:Recently, many unified learning algorithms have been developed for principal component analysis and minor component analysis. These unified algorithms can be used to extract principal components and, if altered simply by the sign, can also serve as a minor component extractor. This is of practical significance in the implementations of algorithms. This paper proposes a unified self-stabilizing neural network learning algorithm for principal and minor components extraction, and studies the stability of the proposed unified algorithm via the fixed-point analysis method. The proposed unified self-stabilizing algorithm for principal and minor components extraction is extended for tracking the principal subspace (PS) and minor subspace (MS). The averaging differential equation and the energy function associated with the unified algorithm for tracking PS and MS are given. It is shown that the averaging differential equation will globally asymptotically converge to an invariance set, and the corresponding energy function exhibit a unique global minimum attained if and only if its state matrices span the PS or MS of the autocorrelation matrix of a vector data stream. It is concluded that the proposed unified algorithm for tracking PS and MS can efficiently track an orthonormal basis of the PS or MS. Simulations are carried out to further illustrate the theoretical results achieved.

Convergence of a Hebbian-type learning algorithm

Convergence Analysis of General Neural Networks under Almost Periodic Stimuli

A Complex Hebbian-type Learning Algorithm with Application to Complex Adaptive ⅡR Filtering

Convergence analysis of a simple minor component analysis algorithm.

Global Convergence of an Adaptive Minor Component Extraction Algorithm

A neural networks learning algorithm for minor component analysis and its convergence analysis

A unified learning algorithm to extract principal and minor components

Convergence Analysis of the Learning Algorithms for Multi-Valued Neurons

Iterative learning based convergence analysis for nonlinear impulsive differential inclusion systems with randomly varying trial lengths

Global Convergence of GHA Learning Algorithm with Nonzero-Approaching Adaptive Learning Rates

Exponential Convergence Estimates for a Single Neuron System of Neutral-Type

A Class of Learning Algorithms for Principal Component Analysis and Minor Component Analysis

Almost Sure Convergence Rates and Concentration of Stochastic Approximation and Reinforcement Learning with Markovian Noise

A Unified Self-Stabilizing Neural Network Algorithm for Principal and Minor Components Extraction.

Convergence Of Nonautonomous Cohen-Grossberg-Type Neural Networks With Variable Delays

Exponential Convergence Behavior of Solutions to Shunting Inhibitory Cellular Neural Networks with Delays and Time-Varying Coefficients

Convergence of Non-Autonomous Discrete-Time Hopfield Model with Delays.

Convergence Analysis of a Discrete-Time Single-Unit Gradient ICA Algorithm

A Modified Oja–Xu MCA Learning Algorithm and Its Convergence Analysis

Convergence dynamics of stochastic Cohen-Grossberg neural networks with unbounded distributed delays

Global Exponential Convergence Analysis of Delayed Neural Networks with Time-Varying Delays