Abstract:Using representations of functional data can be more convenient and beneficial in subsequent statistical models than direct observations. These representations, in a lower-dimensional space, extract and compress information from individual curves. The existing representation learning approaches in functional data analysis usually use linear mapping in parallel to those from multivariate analysis, for example, functional principal component analysis (FPCA). However, functions, as infinite-dimensional objects, sometimes have nonlinear structures that cannot be uncovered by linear mapping. Linear methods will be more overwhelmed by multivariate functional data. For that matter, this article proposes a functional nonlinear learning (FunNoL) method to sufficiently represent multivariate functional data in a lower-dimensional feature space. Furthermore, we merge a classification model for enriching the ability of representations in predicting curve labels. Hence, representations from FunNoL can be used for both curve reconstruction and classification. Additionally, we have endowed the proposed model with the ability to address the missing observation problem as well as to further denoise observations. The resulting representations are robust to observations that are locally disturbed by uncontrollable random noises. We apply the proposed FunNoL method to several real datasets and show that FunNoL can achieve better classifications than FPCA, especially in the multivariate functional data setting. Simulation studies have shown that FunNoL provides satisfactory curve classification and reconstruction regardless of data sparsity. Supplementary materials for this article are available online.

Nonlinear and Nonparametric Extensions

Image Feature Optimization Based on Nonlinear Dimensionality Reduction

Locality Pursuit Embedding

Subspace Embeddings Under Nonlinear Transformations

Is an Affine Constraint Needed for Affine Subspace Clustering?

Subspace Methods for Nonlinear Optimization

Nonlinear Dimension Reduction Via Local Tangent Space Alignment

Functional Nonlinear Learning

Nonlinear Dimensionality Reduction with Local Spline Embedding

Nonlinear Component Analysis as a Kernel Eigenvalue Problem

Distortion-Free Nonlinear Dimensionality Reduction

Functional Nonlinear Sparse Models

Nonlinear Signal Classification in the Framework of High-Dimensional Shape Analysis in Reconstructed State Space

Linear optimal transport subspaces for point set classification

Nonparametric Linear Feature Learning in Regression Through Regularisation

Linear Low-Rank Approximation and Nonlinear Dimensionality Reduction

Subspace learning via Locally Constrained A-optimal nonnegative projection.

Principal manifolds and nonlinear dimension reduction via local tangent space alignment (dept of computer science, pennsylvania state univ, university park, pa)

Nonlinear ICA Using Volume-Preserving Transformations.

Nonparametric Bayes Classification via Learning of Affine Subspaces

High-Dimensional Data Analysis with Low-Dimensional Models