Abstract:Principal component analysis (PCA) is a longstanding and well-studied approach for dimension reduction. It rests upon the assumption that the underlying signal in the data has low rank, and thus can be well-summarized using a small number of dimensions. The output of PCA is typically represented using a scree plot, which displays the proportion of variance explained (PVE) by each principal component. While the PVE is extensively reported in routine data analyses, to the best of our knowledge the notion of inference on the PVE remains unexplored. In this paper, we consider inference on the PVE. We first introduce a new population quantity for the PVE with respect to an unknown matrix mean. Critically, our interest lies in the PVE of the sample principal components (as opposed to unobserved population principal components); thus, the population PVE that we introduce is defined conditional on the sample singular vectors. We show that it is possible to conduct inference, in the sense of confidence intervals, p-values, and point estimates, on this population quantity. Furthermore, we can conduct valid inference on the PVE of a subset of the principal components, even when the subset is selected using a data-driven approach such as the elbow rule. We demonstrate the proposed approach in simulation and in an application to a gene expression dataset.

A Note on the Use of Principal Components in Regression

A note on the variance in principal component regression

Principal Fitted Components for Dimension Reduction in Regression

Principal component analysis: a review and recent developments

A Note on Principal Component Analysis for Multi-Dimensional Data

Prediction by supervised principal components

On the number of variables to use in principal component regression

Robust principal component analysis?

Asymptotic theory of principal component analysis for time series data with cautionary comments

When and why are principal component scores a good tool for visualizing high-dimensional data?

Principal Components Analysis in Clinical Studies

Principal Components and Regularized Estimation of Factor Models

Targeted principal components regression

Principal Component Regression by Principal Component Selection

Dynamic Principal Component Analysis in High Dimensions

A Tutorial on Principal Component Analysis

Principal Component Analysis: Resources for an Essential Application of Linear Algebra

The High-Dimensional Asymptotics of Principal Component Regression

Which principal components to utilize for principal component regression

Regression based thresholds in principal loading analysis

Inference on the proportion of variance explained in principal component analysis