Abstract:This paper introduces a Projected Principal Component Analysis (Projected-PCA), which employs principal component analysis to the projected (smoothed) data matrix onto a given linear space spanned by covariates. When it applies to high-dimensional factor analysis, the projection removes noise components. We show that the unobserved latent factors can be more accurately estimated than the conventional PCA if the projection is genuine, or more precisely, when the factor loading matrices are related to the projected linear space. When the dimensionality is large, the factors can be estimated accurately even when the sample size is finite. We propose a flexible semiparametric factor model, which decomposes the factor loading matrix into the component that can be explained by subject-specific covariates and the orthogonal residual component. The covariates' effects on the factor loadings are further modeled by the additive model via sieve approximations. By using the newly proposed Projected-PCA, the rates of convergence of the smooth factor loading matrices are obtained, which are much faster than those of the conventional factor analysis. The convergence is achieved even when the sample size is finite and is particularly appealing in the high-dimension-low-sample-size situation. This leads us to developing nonparametric tests on whether observed covariates have explaining powers on the loadings and whether they fully explain the loadings. The proposed method is illustrated by both simulated data and the returns of the components of the S&P 500 index.

Iterated and exponentially weighted moving principal component analysis

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

Distance Between Vcs And Its Application To Step-By-Step Multi-Way Pca

Spatio-temporal principal component analysis

Weighted principal component analysis: a weighted covariance eigendecomposition approach

Dynamic Principal Component Analysis in High Dimensions

Ensemble Principal Component Analysis

Robust Principal Component Analysis Based On Maximum Correntropy Power Iterations

To Solve Kernel Principal Component Analysis Using Iterative Method

Projected principal component analysis in factor models

A Fast Data-Oriented Algorithm for Principal Component Analysis

Dynamic Principal Subspaces in High Dimensions

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Principal component analysis: a review and recent developments

Online Robust Principal Component Analysis With Change Point Detection

An Iterative Algorithm for Robust Kernel Principal Component Analysis

Manifold Principle Component Analysis for Large-Dimensional Matrix Elliptical Factor Model

A Covariance-Free Iterative Principal Component Analysis for High Dimensional and Large Scale Data

Robust Principal Component Analysis: A Median of Means Approach

On the structure of dynamic principal component analysis used in statistical process monitoring

Dynamic Principal Subspaces with Sparsity in High Dimensions