Abstract:The aim of this paper is to develop efficient online adaptive algorithms for the generalized eigen-decomposition problem which arises in a variety of modern signal processing applications. First, we reinterpret the generalized eigen-decomposition problem as an unconstrained minimization problem by constructing a novel cost function. Second, by applying projection approximation method and recursive least-square (RLS) technique to the cost function, a parallel adaptive algorithm for a basis for the r-dimensional (r>0) dominant generalized eigen-subspace and a sequential algorithm based on deflation technique for the first r-dominant generalized eigenvectors are derived. These algorithms can be viewed as counterparts of the extended projection approximation subspace tracking (PAST) and PASTd algorithms, respectively. Furthermore, we modify the parallel algorithm to explicitly estimate the first r-generalized eigenvectors in parallel, not the generalized eigen-subspace. More important, the modified parallel algorithm can be used to extract multiple generalized eigenvectors of two nonstationary sequences, while the proposed sequential algorithm lacks this ability because of slow convergence of minor generalized eigenvectors due to error propagation of the deflation technique. Third, following convergence analysis methods for PAST and PASTd, we prove the asymptotic convergence properties of the proposed algorithms. Finally, computer simulations are performed to investigate the accuracy and the speed advantages of the proposed algorithms.

Online Generalized Eigenvectors Extraction Via A Fixed-Point Approach

Online Dominant Generalized Eigenvectors Extraction Via a Randomized Algorithm

Fast Adaptive Extraction Algorithm for Multiple Principal Generalized Eigenvectors

Weighted Rule Based Adaptive Algorithm for Simultaneously Extracting Generalized Eigenvectors

Online Construction of Variable Span Linear Filters Using a Fixed-Point Approach.

The Algebra And Statistics Of Generalized Principal Component Analysis

Fast Adaptive Principal Component Extraction Based on a Generalized Energy Function

Low Complexity Adaptive Algorithm for Generalized Eigenvalue Decomposition

An Efficient Alternating Riemannian/Projected Gradient Descent Ascent Algorithm for Fair Principal Component Analysis

On-line Adaptive Principal Component Extraction Algorithms Using Iteration Approach.

RLS-based Adaptive Algorithms for Generalized Eigen-Decomposition

A few online algorithms for extracting minor generalized eigenvectors

Penalized Orthogonal Iteration for Sparse Estimation of Generalized Eigenvalue Problem

Generalized Eigenvalue Problems with Generative Priors

Adaptive quasi-newton algorithm for extracting generalized eigen subspace

Fixed-point Generalized Maximum Correntropy: Convergence Analysis and Convex Combination Algorithms

Parallel GPU Implementation of Iterative PCA Algorithms

Kernel Optimisation for KPCA Based on Gaussianity Estimation.

Subspace Searching Based Generalized Principal Component Analysis

Nonlinear Component Analysis for Large-Scale Data Set Using Fixed-Point Algorithm

A Sparse Fixed-Point Online KPCA Extraction Algorithm