Abstract:We derive concentration inequalities for the supremum norm of the difference between a kernel density estimator (KDE) and its point-wise expectation that hold uniformly over the selection of the bandwidth and under weaker conditions on the kernel and the data generating distribution than previously used in the literature. We first propose a novel concept, called the volume dimension, to measure the intrinsic dimension of the support of a probability distribution based on the rates of decay of the probability of vanishing Euclidean balls. Our bounds depend on the volume dimension and generalize the existing bounds derived in the literature. In particular, when the data-generating distribution has a bounded Lebesgue density or is supported on a sufficiently well-behaved lower-dimensional manifold, our bound recovers the same convergence rate depending on the intrinsic dimension of the support as ones known in the literature. At the same time, our results apply to more general cases, such as the ones of distribution with unbounded densities or supported on a mixture of manifolds with different dimensions. Analogous bounds are derived for the derivative of the KDE, of any order. Our results are generally applicable but are especially useful for problems in geometric inference and topological data analysis, including level set estimation, density-based clustering, modal clustering and mode hunting, ridge estimation and persistent homology.

Joint Behaviour of Semirecursive Kernel Estimators of the Location and of the Size of the Mode of a Probability Density Function

A note on the convergence rate of the kernel density estimator of the mode

The stochastic approximation method for the estimation of a multivariate probability density

Mode-based estimation of the center of symmetry

Recursive Estimation of Conditional Kernel Mean Embeddings

On kernel mode estimation under RLT and WOD model

Kernel regression, minimax rates and effective dimensionality: beyond the regular case

Markov Kernels and the Conditional Extreme Value Model

Simultaneous semiparametric inference for single-index models

Uniform convergence and asymptotic confidence bands for model-assisted estimators of the mean of sampled functional data

Convolution Mode Regression

Variance-Aware Estimation of Kernel Mean Embedding

Uniform Convergence Rate of the Kernel Density Estimator Adaptive to Intrinsic Volume Dimension

Rates of convergence in conditional covariance matrix with nonparametric entries estimation

Non parametric estimation of residual-past entropy, mean residual-past lifetime, residual-past inaccuracy measure and asymptotic limits

Nonparametric density estimation for the small jumps of Lévy processes

Convergence rates of empirical Bayesian estimation in a class of linear models

Generalized multi-view model: Adaptive density estimation under low-rank constraints

On kernel-based estimation of conditional Kendall's tau: finite-distance bounds and asymptotic behavior

Rates of strong uniform consistency for the $k$-nearest neighbors kernel estimators of density and regression function

Distributed Estimation and Inference for Semi-parametric Binary Response Models