Abstract:The performance of the single kernel-based kernel density estimator (SK-KDE) in fitting a unimodal probability density function (PDF) depends on the choice of kernel function and the corresponding selection of kernel bandwidth. Unlike unimodal PDFs, a multimodal PDF has several distinct features. First, it has multiple local maxima. Second, it is composed of various unimodal PDFs. Each of these unimodal PDFs corresponds to a different collection of random variables. Importantly, these variables are not independent and identically distributed. Because of the difficulty in quantifying multimodality among different modes, it is extremely difficult to select an appropriate kernel function and optimal kernel bandwidth for the multimodal PDF. Multimodal PDFs are frequently encountered in real-world applications. To address this, this paper proposes a novel multiple kernel-based kernel density estimator (MK-KDE). It constructs a flexible KDE by using the weighted average of multiple kernels with consideration of their kernel efficiencies. By integrating multiple kernels, MK-KDE leverages their complementary strengths to enhance the estimation of complex and multimodal PDFs. To achieve this, a novel efficient objective function is designed to obtain the optimized kernel weights and kernel bandwidths by minimizing both the global estimation error of MK-KDE and the local estimation errors of SK-KDEs. Moreover, a sophisticated k -nearest neighbor strategy is devised as a heuristic method to determine the unknown PDF values of given data points, thereby optimizing the aforementioned objective function. A series of extensive experiments was conducted to validate the feasibility, rationality, and effectiveness of MK-KDE for 10 multimodal PDFs. The experimental results show that (1) the kernel weights and bandwidths of MK-KDE converge as the iteration number of the optimization algorithm increases; (2) MK-KDE can fit multimodal PDFs by automatically selecting the kernel functions and bandwidths; and (3) MK-KDE obtains lower estimation errors on 10 multimodal PDFs in comparison to 10 existing PDF estimation methods, demonstrating that MK-KDE is a viable approach to estimate multimodal PDFs.

Review of fast Kernel density estimation algorithms

DEANN: Speeding up Kernel-Density Estimation using Approximate Nearest Neighbor Search

Dynamic Maintenance of Kernel Density Estimation Data Structure: From Practice to Theory

A GPU-accelerated Adaptive Kernel Density Estimation Approach for Efficient Point Pattern Analysis on Spatial Big Data

Face recognition using a kernel fractional-step discriminant analysis algorithm

Fast Rotation Kernel Density Estimation over Data Streams

Adaptive quasiconformal kernel discriminant analysis

A Kernel Density Estimation Method for Linear Features in Network Space

A multiple kernel-based kernel density estimator for multimodal probability density functions

A Quasi-Monte Carlo Data Structure for Smooth Kernel Evaluations

Generalized kernel density estimation based robust estimator and its application

Application of Kernel Density Estimation in Stereo Matching

Fast and Extensible Online Multivariate Kernel Density Estimation

Isolation Kernel Estimators

Fast Private Kernel Density Estimation via Locality Sensitive Quantization

Efficient Kernel Selection Via Spectral Analysis.

ASKIT: Approximate Skeletonization Kernel-Independent Treecode in High Dimensions.

Variable Kernel Density Estimation Based Robust Regression and Its Applications.

Uniform Convergence Rate of the Kernel Density Estimator Adaptive to Intrinsic Volume Dimension

Kernel nonparametric discriminant analysis

Kernel Density Estimation through Density Constrained Near Neighbor Search