Abstract:In this paper we revisit the kernel density estimation problem: given a kernel $K(x, y)$ and a dataset of $n$ points in high dimensional Euclidean space, prepare a data structure that can quickly output, given a query $q$, a ($1+ \epsilon$)-approximation to $\mu:=\frac{1}{\vert P\vert}\sum\nolimits_{p\in P}K(p, q)$. First, we give a single data structure based on classical near neighbor search techniques that improves upon or essentially matches the query time and space complexity for all radial kernels considered in the literature so far. We then show how to improve both the query complexity and runtime by using recent advances in data-dependent near neighbor search. We achieve our results by giving an new implementation of the natural importance sampling scheme. Unlike previous approaches, our algorithm first samples the dataset uniformly (considering a geometric sequence of sampling rates), and then uses existing approximate near neighbor search techniques on the resulting smaller dataset to retrieve the sampled points that lie at an appropriate distance from the query. We show that the resulting sampled dataset has strong geometric structure, making approximate near neighbor search return the required samples much more efficiently than for worst case datasets of the same size. As an example application, we show that this approach yields a data structure that achieves query time and space complexity for the Gaussian kernel. Our data dependent approach achieves query time and space for the Gaussian kernel. The data dependent analysis relies on new techniques for tracking the geometric structure of the input datasets in a recursive hashing process that we hope will be of interest in other applications in near neighbor search.

Probability Density Function Estimation Using Gamma Kernels

Beta Kernel Estimators for Density Functions

EMPIRICAL LIKELIHOOD‐BASED KERNEL DENSITY ESTIMATION

Nonparametric Density Estimation of Hierarchical Probabilistic Graph Models for Assumption-Free Monitoring

Unified treatment of the asymptotics of asymmetric kernel density estimators

Estimating an Inverse Gamma distribution

Kernel Estimation of Density Level Sets

Nonparametric, data-based kernel interpolation for particle-tracking simulations and kernel density estimation

Variational Weighting for Kernel Density Ratios

Empirical Likelihood Confidence Intervals for Nonparametric Density Estimation

Estimation of high dimensional Gamma convolutions through random projections

Kernel Density Estimation through Density Constrained Near Neighbor Search

A kernel estimate for the density of a biological population by using line transect sampling

Adaptive kernel density estimation for improved sky map computation in gamma-ray astronomy

Parametric estimation of discretely sampled Gamma-OU processes

Robust Estimation for Kernel Exponential Families with Smoothed Total Variation Distances

An Evaluation of the Accuracy of Kernel Density Estimators for Home Range Analysis

Probability-Generating Function Kernels for Spherical Data

Faster estimation for constrained gamma mixture models using closed-form estimators

Non-central limit of densities of some functionals of Gaussian processes

Robust Sparse Kernel Density Estimation by Inducing Randomness