Abstract:Despite two decades of success, traditional methods in functional data analysis predominantly rely on linear models, which are limited in their ability to encapsulate the complex and nonlinear relationships inherent in data. In contrast, deep neural networks (DNNs), known for their proficiency in managing high‐dimensional spaces, offer a significant advancement over traditional techniques. Recent advancements in research highlight the versatility of DNNs across a spectrum of tasks in functional data analysis. This includes functional regression, classification, and representation, which are effectively applied to both one‐dimensional (1D) and two‐dimensional (2D) functional data. Functional data analysis is an evolving field focused on analyzing data that reveals insights into curves, surfaces, or entities within a continuous domain. This type of data is typically distinguished by the inherent dependence and smoothness observed within each data curve. Traditional functional data analysis approaches have predominantly relied on linear models, which, while foundational, often fall short in capturing the intricate, nonlinear relationships within the data. This paper seeks to bridge this gap by reviewing the integration of deep neural networks into functional data analysis. Deep neural networks present a transformative approach to navigating these complexities, excelling particularly in high‐dimensional spaces and demonstrating unparalleled flexibility in managing diverse data constructs. This review aims to advance functional data regression, classification, and representation by integrating deep neural networks with functional data analysis, fostering a harmonious and synergistic union between these two fields. The remarkable ability of deep neural networks to adeptly navigate the intricate functional data highlights a wealth of opportunities for ongoing exploration and research across various interdisciplinary areas. This article is categorized under: Data: Types and Structure > Time Series, Stochastic Processes, and Functional Data Statistical Learning and Exploratory Methods of the Data Sciences > Deep Learning Statistical Learning and Exploratory Methods of the Data Sciences > Neural Networks

Estimation of the Mean Function of Functional Data via Deep Neural Networks

Robust Deep Neural Network Estimation for Multi-dimensional Functional Data

Nonlinear functional regression by functional deep neural network with kernel embedding

Nonparametric regression for repeated measurements with deep neural networks

Nonparametric regression using deep neural networks with ReLU activation function

Functional data analysis using deep neural networks

Sparse deep neural networks for nonparametric estimation in high-dimensional sparse regression

Noninvasive Estimation of Macro-Parameters by Deep Learning

Deep Neural Networks are Adaptive to Function Regularity and Data Distribution in Approximation and Estimation

Deep Nonparametric Regression on Approximate Manifolds: Non-Asymptotic Error Bounds with Polynomial Prefactors

Nonparametric Estimation for High-Dimensional Space Models Based on a Deep Neural Network

Functional Linear Partial Quantile Regression with Guaranteed Convergence for Neuroimaging Data Analysis

Near-Minimax Optimal Estimation With Shallow ReLU Neural Networks

Near-optimal learning of Banach-valued, high-dimensional functions via deep neural networks

Functional data learning using convolutional neural networks

Robust Nonparametric Regression with Deep Neural Networks

Asymptotic Distributions of Nonparametric Regression Estimators for Longitudinal or Functional Data

Robust nonparametric regression based on deep ReLU neural networks

Why Deep Neural Networks for Function Approximation?

Asymptotic normality of locally modelled regression estimator for functional data

Estimation of a regression function on a manifold by fully connected deep neural networks