Robust Functional Data Analysis for Discretely Observed Data

Lingxuan Shao,Fang Yao
2023-05-26
Abstract:This paper examines robust functional data analysis for discretely observed data, where the underlying process encompasses various distributions, such as heavy tail, skewness, or contaminations. We propose a unified robust concept of functional mean, covariance, and principal component analysis, while existing methods and definitions often differ from one another or only address fully observed functions (the ``ideal'' case). Specifically, the robust functional mean can deviate from its non-robust counterpart and is estimated using robust local linear regression. Moreover, we define a new robust functional covariance that shares useful properties with the classic version. Importantly, this covariance yields the robust version of Karhunen--Loève decomposition and corresponding principal components beneficial for dimension reduction. The theoretical results of the robust functional mean, covariance, and eigenfunction estimates, based on pooling discretely observed data (ranging from sparse to dense), are established and aligned with their non-robust counterparts. The newly-proposed perturbation bounds for estimated eigenfunctions, with indexes allowed to grow with sample size, lay the foundation for further modeling based on robust functional principal component analysis.
Methodology,Statistics Theory
What problem does this paper attempt to address?
### Problems Addressed by the Paper This paper primarily explores robust functional data analysis methods under discrete observation data. Specifically, the authors propose a unified robust framework for handling functional means, covariances, and principal component analysis in the presence of various distributions (such as heavy-tailed, skewed, or contaminated). 1. **Robust Functional Mean**: - A new robust functional mean estimation method is proposed, capable of handling asymmetric or skewed datasets, and it uses robust local linear regression for estimation. - The robust mean may differ from the traditional mean, especially in the commonly encountered asymmetric or skewed distributions in practice. 2. **Robust Functional Covariance**: - A new robust functional covariance is defined, possessing some useful properties of classical covariance, such as the covariance of independent variables being zero. - This robust covariance naturally leads to Karhunen-Loève decomposition, which further aids in modeling, such as functional linear regression. 3. **Robust Functional Principal Component Analysis**: - Based on the proposed robust covariance, a corresponding robust principal component analysis method is derived, which can effectively perform dimensionality reduction. - The effectiveness of the proposed method is validated through numerical studies and applied to an empirical analysis of an Alzheimer's disease dataset. Overall, this paper aims to address the problem of conducting robust functional data analysis under discrete observation data, particularly when the data exhibits complex distribution characteristics, and how to improve the robustness and accuracy of the analysis through robust methods.