Abstract:U-statistics represent a fundamental class of statistics arising from modeling quantities of interest defined by multi-subject responses. U-statistics generalize the empirical mean of a random variable X to sums over every m-tuple of distinct observations of X. Stute (Ann Probab 19(2):812–825, 1991) introduced a class of so-called conditional U-statistics, which may be viewed as a generalization of the Nadaraya–Watson estimates of a regression function. Stute proved their strong pointwise consistency to: r(m)(φ,t):=E[φ(Y1,…,Ym)|(X1,…,Xm)=t],fort∈Rdm.\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\begin{aligned} r^{(m)}(\varphi ,\mathbf { t}):=\mathbb {E}[\varphi (Y_{1},\ldots ,Y_{m})|(X_{1},\ldots ,X_{m})=\mathbf {t}], ~~\text{ for }~~\mathbf { t}\in \mathbb {R}^{dm}. \end{aligned}$$\end{document}In the present paper, we introduce the k nearest neighborhoods estimator of the conditional U-statistics depending on an infinite-dimensional covariate. A sharp uniform in the number of neighborhoods (UINN) limit law for the proposed estimator is presented. Such result allows the NN to vary within a complete range for which the estimator is consistent. Consequently, it represents an interesting guideline in practice to select the optimal NN in the nonparametric functional data analysis. In addition, uniform consistency is also established over φ∈F$$\varphi \in \mathscr {F}$$ for a suitably restricted class F$$\mathscr {F}$$, in both cases bounded and unbounded, satisfying some moment conditions and some mild conditions on the model. This paper unifies the approaches in some other recent papers. As a by-product of our proofs, we state consistency results for the k-NN conditional U-statistics, under the random censoring, which are uniform in the number of neighbors. The theoretical uniform consistency results, established in this paper, are (or will be) key tools for many further developments in functional data analysis.

Nearest neighbor empirical processes

Accelerating Exact Nearest Neighbor Search in High Dimensional Euclidean Space Via Block Vectors

Multivariate nearest‐neighbors Gaussian processes with random covariance matrices

Variational Nearest Neighbor Gaussian Process

Discriminant adaptive nearest neighbor classification and regression

Further Understanding of a Local Gaussian Process Approximation: Characterising Convergence in the Finite Regime

Uniform consistency and uniform in number of neighbors consistency for nonparametric regression estimates and conditional U-statistics involving functional data

The local linear functional kNN estimator of the conditional expectile: uniform consistency in number of neighbors

Nearest Neighbor Dirichlet Mixtures

Bayesian Geostatistical Modeling for Discrete-Valued Processes

Strong Convergence Rates of Nearest Neighbor Estimators for Regression Function under Random Censored

Central limit theorems for the nearest neighbour embracing graph in Euclidean and hyperbolic space

On high-dimensional modifications of the nearest neighbor classifier

Varentropy Estimation via Nearest Neighbor Graphs

On the Consistency of Exact and Approximate Nearest Neighbor with Noisy Data.

Uniform in number of neighbors consistency and weak convergence of $ k $NN empirical conditional processes and $ k $NN conditional $ U $-processes involving functional mixing data

Nearest Neighbor and Kernel Survival Analysis: Nonasymptotic Error Bounds and Strong Consistency Rates

The Nearest Neighbor Algorithm of Local Probability Centers

A Bayesian reassessment of nearest-neighbour classification

A Kernel-Based Conditional Two-Sample Test Using Nearest Neighbors (with Applications to Calibration, Regression Curves, and Simulation-Based Inference)