Abstract:Functional data analysis is an important research field in statistics which treats data as random functions drawn from some infinite-dimensional functional space, and functional principal component analysis (FPCA) based on eigen-decomposition plays a central role for data reduction and representation. After nearly three decades of research, there remains a key problem unsolved, namely, the perturbation analysis of covariance operator for diverging number of eigencomponents obtained from noisy and discretely observed data. This is fundamental for studying models and methods based on FPCA, while there has not been substantial progress since Hall, Müller and Wang (2006)'s result for a fixed number of eigenfunction estimates. In this work, we aim to establish a unified theory for this problem, obtaining upper bounds for eigenfunctions with diverging indices in both the $\mathcal{L}^2$ and supremum norms, and deriving the asymptotic distributions of eigenvalues for a wide range of sampling schemes. Our results provide insight into the phenomenon when the $\mathcal{L}^{2}$ bound of eigenfunction estimates with diverging indices is minimax optimal as if the curves are fully observed, and reveal the transition of convergence rates from nonparametric to parametric regimes in connection to sparse or dense sampling. We also develop a double truncation technique to handle the uniform convergence of estimated covariance and eigenfunctions. The technical arguments in this work are useful for handling the perturbation series with noisy and discretely observed functional data and can be applied in models or those involving inverse problems based on FPCA as regularization, such as functional linear regression.

Towards a Theoretical Analysis of PCA for Heteroscedastic Data

HePPCAT: Probabilistic PCA for Data with Heteroscedastic Noise

Robust Principal Component Analysis Based on Maximum Correntropy Criterion

ALPCAH: Sample-wise Heteroscedastic PCA with Tail Singular Value Regularization

Inference for Heteroskedastic PCA with Missing Data

Streaming Probabilistic PCA for Missing Data with Heteroscedastic Noise

Deflated HeteroPCA: Overcoming the curse of ill-conditioning in heteroskedastic PCA

Cauchy Principal Component Analysis

On the Estimation Performance of Generalized Power Method for Heteroscedastic Probabilistic PCA

High-Dimensional Principal Component Analysis with Heterogeneous Missingness

Ensemble Principal Component Analysis

HeMPPCAT: Mixtures of Probabilistic Principal Component Analysers for Data with Heteroscedastic Noise

Optimal Spectral Shrinkage and PCA With Heteroscedastic Noise

On the asymptotic properties of product-PCA under the high-dimensional setting

Self-Paced Probabilistic Principal Component Analysis for Data with Outliers

Self-paced Principal Component Analysis

Selecting the number of components in PCA via random signflips

Theory of functional principal component analysis for discretely observed data

Robust PCA for High Dimensional Data based on Characteristic Transformation

Robust Principal Component Analysis via Discriminant Sample Weight Learning

Dynamic Principal Subspaces in High Dimensions