Abstract:“Principal Component Analysis” (PCA) is an established linear technique for dimensionality reduction. It performs an orthonormal transformation to replace possibly correlated variables with a smaller set of linearly independent variables, the so-called principal components, which capture a large portion of the data variance. The problem of finding the optimal number of principal components has been widely studied for offline PCA. However, when working with streaming data, the optimal number changes continuously. This requires to update both the principal components and the dimensionality in every timestep. While the continuous update of the principal components is widely studied, the available algorithms for dimensionality adjustment are limited to an increment of one in neural network-based and incremental PCA. Therefore, existing approaches cannot account for abrupt changes in the presented data. The contribution of this work is to enable in neural network-based PCA the continuous dimensionality adjustment by an arbitrary number without the necessity to learn all principal components. A novel algorithm is presented that utilizes several PCA characteristics to adaptivly update the optimal number of principal components for neural network-based PCA. A precise estimation of the required dimensionality reduces the computational effort while ensuring that the desired amount of variance is kept. The computational complexity of the proposed algorithm is investigated and it is benchmarked in an experimental study against other neural network-based and incremental PCA approaches where it produces highly competitive results.

Nonlinear principal component analysis using autoassociative neural networks

Developments and Applications of Nonlinear Principal Component Analysis – a Review

Adaptive Kpca Modeling of Nonlinear Systems

Neural Network Learning to Non-Linear Principal Component Analysis

A Method For Fermentation Process Monitoring Via Nonlinear Pca

Block Adaptive Kernel Principal Component Analysis for Nonlinear Process Monitoring

Nonlinear Functional Principal Component Analysis Using Neural Networks

New Nonlinear Principal Analysis Method Based on RBF Neural Network

Auto-associative models, nonlinear Principal component analysis, manifolds and projection pursuit

Nonlinear principal component analysis based on RBF neural network and principal curve

Adaptive dimensionality reduction for neural network-based online principal component analysis

Neural Component Analysis for Fault Detection

Structured Principal Component Analysis Model With Variable Correlation Constraint

Nonlinear Principal Manifolds --- Adaptive Hybrid Learning Approaches

Nonlinear Process Monitoring Using Improved Kernel Principal Component Analysis

PCA-Boosted Autoencoders for Nonlinear Dimensionality Reduction in Low Data Regimes

Deep Contrastive Principal Component Analysis Adaptive to Nonlinear Data

Biologically Plausible Online Principal Component Analysis Without Recurrent Neural Dynamics

nPCA: a linear dimensionality reduction method using a multilayer perceptron

Maximally Correlated Principal Component Analysis Based on Deep Parameterization Learning.

A High Accuracy Nonlinear Dimensionality Reduction Optimization Method.