Abstract:“Principal Component Analysis” (PCA) is an established linear technique for dimensionality reduction. It performs an orthonormal transformation to replace possibly correlated variables with a smaller set of linearly independent variables, the so-called principal components, which capture a large portion of the data variance. The problem of finding the optimal number of principal components has been widely studied for offline PCA. However, when working with streaming data, the optimal number changes continuously. This requires to update both the principal components and the dimensionality in every timestep. While the continuous update of the principal components is widely studied, the available algorithms for dimensionality adjustment are limited to an increment of one in neural network-based and incremental PCA. Therefore, existing approaches cannot account for abrupt changes in the presented data. The contribution of this work is to enable in neural network-based PCA the continuous dimensionality adjustment by an arbitrary number without the necessity to learn all principal components. A novel algorithm is presented that utilizes several PCA characteristics to adaptivly update the optimal number of principal components for neural network-based PCA. A precise estimation of the required dimensionality reduces the computational effort while ensuring that the desired amount of variance is kept. The computational complexity of the proposed algorithm is investigated and it is benchmarked in an experimental study against other neural network-based and incremental PCA approaches where it produces highly competitive results.

On-line Adaptive Principal Component Extraction Algorithms Using Iteration Approach.

Adaptive Kpca Modeling of Nonlinear Systems

Block Adaptive Kernel Principal Component Analysis for Nonlinear Process Monitoring

Step-by-Step Adaptive MPCA Applied to an Industrial Batch Process

Moving window kernel PCA for adaptive monitoring of nonlinear processes

Fermentation Batch Process Monitoring by Step-by-Step Adaptive MPCA

Adaptive Principal Component Analysis Combined with Feature Extraction-Based Method for Feature Identification in Manufacturing

Recursive kernel PCA and its application in adaptive monitoring of nonlinear processes

Online Generalized Eigenvectors Extraction Via A Fixed-Point Approach

Adaptive dimensionality reduction for neural network-based online principal component analysis

An adaptive learning algorithm for principal component analysis

Online Adaptive Principal Component Analysis and Its extensions

Online Principal Component Analysis in High Dimension: Which Algorithm to Choose?

Robust adaptive algorithms for fast principal component analysis

On-line diagnosis of abnormal conditions of air separation process by dynamic PCA

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Adaptive PCA for Time-Varying Data

Near-optimal stochastic approximation for online principal component estimation

Online Robust Principal Component Analysis With Change Point Detection

Nonlinear Dynamic Principal Component Analysis For On-Line Process Monitoring And Diagnosis

An Efficient Alternating Riemannian/Projected Gradient Descent Ascent Algorithm for Fair Principal Component Analysis