Abstract:We consider non-parametric density estimation in the framework of local approximate differential privacy. In contrast to centralized privacy scenarios with a trusted curator, in the local setup anonymization must be guaranteed already on the individual data owners' side and therefore must precede any data mining tasks. Thus, the published anonymized data should be compatible with as many statistical procedures as possible. We suggest adding Laplace noise and Gaussian processes (both appropriately scaled) to kernel density estimators to obtain approximate differential private versions of the latter ones. We obtain minimax type results over Sobolev classes indexed by a smoothness parameter $s>1/2$ for the mean squared error at a fixed point. In particular, we show that taking the average of private kernel density estimators from $n$ different data owners attains the optimal rate of convergence if the bandwidth parameter is correctly specified. Notably, the optimal convergence rate in terms of the sample size $n$ is $n^{-(2s-1)/(2s+1)}$ under local differential privacy and thus deteriorated to the rate $n^{-(2s-1)/(2s)}$ which holds without privacy restrictions. Since the optimal choice of the bandwidth parameter depends on the smoothness $s$ and is thus not accessible in practice, adaptive methods for bandwidth selection are necessary and must, in the local privacy framework, be performed directly on the anonymized data. We address this problem by means of a variant of Lepski's method tailored to the privacy setup and obtain general oracle inequalities for private kernel density estimators. In the Sobolev case, the resulting adaptive estimator attains the optimal rate of convergence at least up to extra logarithmic factors.

Isolation Kernel Density Estimation

Isolation Kernel Estimators

Isolation Distributional Kernel: A New Tool for Kernel Based Anomaly Detection

Isolation Distributional Kernel: A New Tool for Point & Group Anomaly Detection.

Kernel-based Clustering Via Isolation Distributional Kernel

Limit theorems for kernel density estimators under dependent samples

Multivariate Statistical Process Monitoring Using Kernel Density Estimation

Isolation Kernel and Its Effect on SVM

Adaptive quasiconformal kernel discriminant analysis

TAKDE: Temporal Adaptive Kernel Density Estimator for Real-Time Dynamic Density Estimation

Fast Private Kernel Density Estimation via Locality Sensitive Quantization

Uniform Convergence Rate of the Kernel Density Estimator Adaptive to Intrinsic Volume Dimension

Isolation Graph Kernel.

A Local Density-Based Approach for Local Outlier Detection

Multivariate Locally Adaptive Kernel Density Estimation

Dynamic Maintenance of Kernel Density Estimation Data Structure: From Practice to Theory

Learning Adaptive Kernels for Statistical Independence Tests.

Kernel density estimation of allele frequency including undetected alleles

Isolation Kernel: The X Factor in Efficient and Effective Large Scale Online Kernel Learning

Pointwise adaptive kernel density estimation under local approximate differential privacy

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification