Abstract:The estimation of cumulative distribution functions (CDF) is an important learning task with a great variety of downstream applications, such as risk assessments in predictions and decision making. In this paper, we study functional regression of contextual CDFs where each data point is sampled from a linear combination of context dependent CDF basis functions. We propose functional ridge-regression-based estimation methods that estimate CDFs accurately everywhere. In particular, given $n$ samples with $d$ basis functions, we show estimation error upper bounds of $\widetilde O(\sqrt{d/n})$ for fixed design, random design, and adversarial context cases. We also derive matching information theoretic lower bounds, establishing minimax optimality for CDF functional regression. Furthermore, we remove the burn-in time in the random design setting using an alternative penalized estimator. Then, we consider agnostic settings where there is a mismatch in the data generation process. We characterize the error of the proposed estimators in terms of the mismatched error, and show that the estimators are well-behaved under model mismatch. Moreover, to complete our study, we formalize infinite dimensional models where the parameter space is an infinite dimensional Hilbert space, and establish a self-normalized estimation error upper bound for this setting. Notably, the upper bound reduces to the $\widetilde O(\sqrt{d/n})$ bound when the parameter space is constrained to be $d$-dimensional. Our comprehensive numerical experiments validate the efficacy of our estimation methods in both synthetic and practical settings.

Local linear estimation for the censored functional regression

Local Linear M‐estimation in Non‐parametric Spatial Regression

The effect of correlated errors on the performance of local linear estimation of regression function based on random functional design

Modified Local Linear Estimators in Partially Linear Additive Models with Right-Censored Data Based on Different Censorship Solution Techniques

Locally sparse estimator for functional linear panel models with fixed effects

Functional Coefficient Estimation with Both Categorical and Continuous Data

Locally Sparse Function on function Regression

Estimation and inference for functional linear regression models with partially varying regression coefficients

The strong consistency and asymptotic normality of the kernel estimator type in functional single index model in presence of censored data

On some stable linear functional regression estimators based on random projections

ON THE ESTIMATION AND TESTING OF FUNCTIONAL-COEFFICIENT LINEAR MODELS

Asymptotic normality of locally modelled regression estimator for functional data

Scalar-on-function local linear regression and beyond

Local Linear Estimation for Regression Models with Locally Stationary Long Memory Errors

Local Linear GMM Estimation of Functional Coefficient IV Models with an Application to Estimating the Rate of Return to Schooling

Robust estimation for functional logistic regression models

Estimation in functional partially linear spatial autoregressive model

Rank Estimation in Partial Linear Model with Censored Data

FLCRM: Functional linear cox regression model

Functional Linear Regression of Cumulative Distribution Functions

Online Regularized Learning Algorithm for Functional Data