Abstract:Functional linear and single-index models are core regression methods in functional data analysis and are widely used for performing regression in a wide range of applications when the covariates are random functions coupled with scalar responses. In the existing literature, however, the construction of associated estimators and the study of their theoretical properties is invariably carried out on a case-by-case basis for specific models under consideration. In this work, assuming the predictors are Gaussian processes, we provide a unified methodological and theoretical framework for estimating the index in functional linear, and its direction in single-index models. In the latter case, the proposed approach does not require the specification of the link function. In terms of methodology, we show that the reproducing kernel Hilbert space (RKHS) based functional linear least-squares estimator, when viewed through the lens of an infinite-dimensional Gaussian Stein's identity, also provides an estimator of the index of the single-index model. Theoretically, we characterize the convergence rates of the proposed estimators for both linear and single-index models. Our analysis has several key advantages: (i) it does not require restrictive commutativity assumptions for the covariance operator of the random covariates and the integral operator associated with the reproducing kernel; and (ii) the true index parameter can lie outside of the chosen RKHS, thereby allowing for index misspecification as well as for quantifying the degree of such index misspecification. Several existing results emerge as special cases of our analysis.

An RKHS model for variable selection in functional regression

A method for variable selection in a multivariate functional linear regression model

On the functional regression model and its finite-dimensional approximations

Nonlinear Multivariate Function-on-function Regression with Variable Selection

A Bayesian approach to functional regression: theory and computation

Variable Selection and Minimax Prediction in High-dimensional Functional Linear Model

Functional Linear Regression with Mixed Predictors

EFFICIENT KERNEL-BASED VARIABLE SELECTION WITH SPARSISTENCY

Functional variable selection via Gram–Schmidt orthogonalization for multiple functional linear regression

Variable Selection for Multiple Function-on-Function Linear Regression

Bayesian variable selection in linear regression models with instrumental variables

Sure independent screening for functional regression model

Estimation in Functional Single-Index Varying Coefficient Model

Estimation and Variable Selection for Generalized Functional Partially Varying Coefficient Hybrid Models

Kernel partial least squares regression for functional nonlinear models

On functional logistic regression: some conceptual issues

Partially Functional Linear Regression in High Dimensions

Variable Selection in Functional Linear Concurrent Regression

A new RKHS-based global testing for functional linear model

Functional linear and single-index models: A unified approach via Gaussian Stein identity

A two-stage evolutionary algorithm for variable selection in the development of RBF neural network models