Abstract:Robust estimation with high break down point is an important and fundamental topic in computer vision, machine learning and many other areas. Traditional robust estimator with a break down point more than 50%, for illustration, Random Sampling Consensus and its derivatives, needs a user specified scale of inliers such that inliers can be distinguished from outliers, but in many applications, we do not have any a priori of the scale of inliers, so an empirical value is usually specified. In recent years, a group of Kernel Density Estimation (KDE) based robust estimators has been proposed to solve this problem. However, as the most important parameter, bandwidth, for KDE is highly correlated to the scale of inliers, these methods turned out to be a scale estimator for inliers, and it is not an easy work to estimate the scale of inliers. Thus, the authors build up a robust estimator based on Variable Kernel Density Estimation (VKDE). Compared to KDE, VKDE estimates bandwidth out of local information of samples by using K-Nearest-Neighbor method instead of estimating bandwidth from the scale of inliers. Thus the estimation for the scale of inliers can be omitted. Furthermore, as variable bandwidth technique is applied, the proposed method uses smaller bandwidths for the areas where samples are more densely distributed. As inliers are much more densely distributed than outliers, the proposed method achieved a higher resolution for inliers, and then the peak of estimated density will be closer to the point near which samples are most densely distributed. At last, the proposed method is compared to two most widely used robust estimators, Random Sampling Consensus and Least Median Square. From the result we can see that it has higher precision than those two methods.

Robust Kernels for Kernel Density Estimation

A weighted least-squares cross-validation bandwidth selector for kernel density estimation

Cross-validatory Framework for Optimal Parameter Estimation of KPCA and KPLS Models

Novel kernel density estimator based on ensemble unbiased cross-validation

Variable Kernel Density Estimation Based Robust Regression and Its Applications.

Efficient Bandwidth Selection for Kernel Density Estimation

Robust Regularized Kernel Regression.

Robust Sparse Kernel Density Estimation by Inducing Randomness

Kernel density estimation based distributionally robust mean-CVaR portfolio optimization

Robust Kernel (Cross-) Covariance Operators in Reproducing Kernel Hilbert Space toward Kernel Methods

Kernel density weighted method of obtaining the least square support vector machines weightes

Kernel‐based Generalized Cross‐validation in Non‐parametric Mixed‐effect Models

Generalized kernel density estimation based robust estimator and its application

Cross-validation in nonparametric regression with outliers

Multivariate Locally Adaptive Kernel Density Estimation

Kernel-based Regression Via a Novel Robust Loss Function and Iteratively Reweighted Least Squares

Robust variable kernel width for maximum correntropy criterion algorithm

Preventing Over-Fitting of Cross-Validation with Kernel Stability.

Data-driven Robust Optimization Based on Kernel Learning.

Numerical performance of Penalized Comparison to Overfitting for multivariate kernel density estimation

Bandwidth Selection for Kernel Density Estimation with a Markov Chain Monte Carlo Sample