Abstract:We derive concentration inequalities for the supremum norm of the difference between a kernel density estimator (KDE) and its point-wise expectation that hold uniformly over the selection of the bandwidth and under weaker conditions on the kernel and the data generating distribution than previously used in the literature. We first propose a novel concept, called the volume dimension, to measure the intrinsic dimension of the support of a probability distribution based on the rates of decay of the probability of vanishing Euclidean balls. Our bounds depend on the volume dimension and generalize the existing bounds derived in the literature. In particular, when the data-generating distribution has a bounded Lebesgue density or is supported on a sufficiently well-behaved lower-dimensional manifold, our bound recovers the same convergence rate depending on the intrinsic dimension of the support as ones known in the literature. At the same time, our results apply to more general cases, such as the ones of distribution with unbounded densities or supported on a mixture of manifolds with different dimensions. Analogous bounds are derived for the derivative of the KDE, of any order. Our results are generally applicable but are especially useful for problems in geometric inference and topological data analysis, including level set estimation, density-based clustering, modal clustering and mode hunting, ridge estimation and persistent homology.

Consistency of Kernel Density Estimators for Causal Processes

Asymptotic Distributions of Innovation Density Estimators in Linear Processes

Limit theorems for kernel density estimators under dependent samples

Local Linear M-Estimators in Null Recurrent Time Series

ASYMPTOTIC NORMALITY OF KERNEL ESTIMATES OF A DENSITY FUNCTION UNDER ASSOCIATION DEPENDENCE

On Convergence to Stochastic Integrals

Varying Coefficient Partially Nonlinear Models with Nonstationary Regressors

Multivariate Statistical Process Monitoring Using Kernel Density Estimation

The L-1-Norm Kernel Estimator of Conditional Median for Stationary Processes

Kernel Generated Two-Time Parameter Gaussian Processes and Some of Their Path Properties

On Bernstein Type Inequalities for Stochastic Integrals of Multivariate Point Processes

Asymptotic Behavior for S-estimators in Random Design Linear Model with Long-Range-dependent Errors

The functional central limit theorem for linear processes with strong near-epoch dependent innovations

Asymptotic properties of kernel density and hazard rate function estimators with censored widely orthant dependent data

A note on the convergence rate of the kernel density estimator of the mode

Uniform Convergence Rate of the Kernel Density Estimator Adaptive to Intrinsic Volume Dimension

Kernel Methods for Causal Functions: Dose, Heterogeneous, and Incremental Response Curves

Strong convergence rate of estimators of change point and its application

Time-varying multivariate causal processes

Convergence of the CUSUM estimation for a mean shift in linear processes with random coefficients

The strong consistency and asymptotic normality of the kernel estimator type in functional single index model in presence of censored data