Abstract:Using representations of functional data can be more convenient and beneficial in subsequent statistical models than direct observations. These representations, in a lower-dimensional space, extract and compress information from individual curves. The existing representation learning approaches in functional data analysis usually use linear mapping in parallel to those from multivariate analysis, for example, functional principal component analysis (FPCA). However, functions, as infinite-dimensional objects, sometimes have nonlinear structures that cannot be uncovered by linear mapping. Linear methods will be more overwhelmed by multivariate functional data. For that matter, this article proposes a functional nonlinear learning (FunNoL) method to sufficiently represent multivariate functional data in a lower-dimensional feature space. Furthermore, we merge a classification model for enriching the ability of representations in predicting curve labels. Hence, representations from FunNoL can be used for both curve reconstruction and classification. Additionally, we have endowed the proposed model with the ability to address the missing observation problem as well as to further denoise observations. The resulting representations are robust to observations that are locally disturbed by uncontrollable random noises. We apply the proposed FunNoL method to several real datasets and show that FunNoL can achieve better classifications than FPCA, especially in the multivariate functional data setting. Simulation studies have shown that FunNoL provides satisfactory curve classification and reconstruction regardless of data sparsity. Supplementary materials for this article are available online.

Functional Multi-Layer Perceptron: a Nonlinear Tool for Functional Data Analysis

Representation of Functional Data in Neural Networks

Multilayer Perceptron for Sparse Functional Data

Complex Functional Networks

Functional Network Method for the Identification of Nonlinear Systems

Functional Network: A Novel Framework for Interpretability of Deep Neural Networks

Functional Nonlinear Learning

Neural Functional Transformers

Nonlinear functional regression by functional deep neural network with kernel embedding

Functional Graph Convolutional Networks: A unified multi-task and multi-modal learning framework to facilitate health and social-care insights

Deep Learning With Functional Inputs

Permutation Equivariant Neural Functionals

A Nonparametric Graphical Model for Functional Data With Application to Brain Networks Based on fMRI

A Functional Extension of Semi-Structured Networks

Structured and Balanced Multi-component and Multi-layer Neural Networks

Deep Neural Network Classifier for Multi-dimensional Functional Data

Nonlinear Functional Principal Component Analysis Using Neural Networks

Functional data learning using convolutional neural networks

Single and multiple index functional regression models with nonparametric link

Neural Networks as Functional Classifiers

Deep Learning for Functional Data Analysis with Adaptive Basis Layers