Abstract:We derive concentration inequalities for the supremum norm of the difference between a kernel density estimator (KDE) and its point-wise expectation that hold uniformly over the selection of the bandwidth and under weaker conditions on the kernel and the data generating distribution than previously used in the literature. We first propose a novel concept, called the volume dimension, to measure the intrinsic dimension of the support of a probability distribution based on the rates of decay of the probability of vanishing Euclidean balls. Our bounds depend on the volume dimension and generalize the existing bounds derived in the literature. In particular, when the data-generating distribution has a bounded Lebesgue density or is supported on a sufficiently well-behaved lower-dimensional manifold, our bound recovers the same convergence rate depending on the intrinsic dimension of the support as ones known in the literature. At the same time, our results apply to more general cases, such as the ones of distribution with unbounded densities or supported on a mixture of manifolds with different dimensions. Analogous bounds are derived for the derivative of the KDE, of any order. Our results are generally applicable but are especially useful for problems in geometric inference and topological data analysis, including level set estimation, density-based clustering, modal clustering and mode hunting, ridge estimation and persistent homology.

Limit theorems for kernel density estimators under dependent samples

ASYMPTOTIC NORMALITY OF KERNEL ESTIMATES OF A DENSITY FUNCTION UNDER ASSOCIATION DEPENDENCE

The Functional Central Limit Theorem for Strong Near-Epoch Dependent Random Variables *

An Almost Sure Central Limit Theorem for Self-Normalized Partial Sums of Weakly Dependent Random Variables

The functional central limit theorem for linear processes with strong near-epoch dependent innovations

The Asymptotic Distribution and Berry–Esseen Bound of a New Test for Independence in High Dimension with an Application to Stochastic Optimization

Uniform Convergence Rate of the Kernel Density Estimator Adaptive to Intrinsic Volume Dimension

Consistency for the Kernel-type Density Estimator in the Case of M-Dependent Samples

Strong Limit Theorems for Extended Independent Random Variables and Extended Negatively Dependent Random Variables under Sub-Linear Expectations

The Berry-Esséen Bounds for Kernel Density Estimator under Dependent Sample

Convergent Rate of Nonparametric Kernel Estimate under Mixing Dependent Data

Limit Theorems for Dependent Bernoulli Variables with Statistical Inference

Central limit theorems for high dimensional dependent data

Consistency of Kernel Density Estimators for Causal Processes

Equivalent Conditions of Complete Moment and Integral Convergence for a Class of Dependent Random Variables

Wasserstein-p Bounds in the Central Limit Theorem Under Weak Dependence

Some inequalities for strong mixing random variables with applications to density estimation

Random Weighting Estimation Of Kernel Density

Some uniform convergence results for kernel estimators

Asymptotic normality of kernel density estimation for mixing high-frequency data

Deriving Matrix Concentration Inequalities from Kernel Couplings