Abstract:Maximum correntropy criterion (MCC) is a robust and powerful technique to handle heavy-tailed non-Gaussian noise, which has many applications in the fields of vision, signal processing, machine learning, etc. In this paper, we introduce several contributions to the MCC and propose an augmented MCC (AMCC), which raises the robustness of classic MCC variants for robust fitting to an unprecedented level. Our first contribution is to present an accurate bandwidth estimation algorithm based on the probability density function (PDF) matching, which solves the instability problem of the Silverman's rule. Our second contribution is to introduce the idea of graduated non-convexity (GNC) and a worst-rejection strategy into MCC, which compensates for the sensitivity of MCC to high outlier ratios. Our third contribution is to provide a definition of local distribution measure (LDM) to evaluate the quality of inliers, which makes the MCC no longer limited to random outliers but is generally suitable for both random and clustered outliers. Our fourth contribution is to show the generalizability of the proposed AMCC by providing eight application examples in geometry perception and performing comprehensive evaluations on five of them. Our experiments demonstrate that (i) AMCC is empirically robust to 80% $\sim$ 90% of random outliers across applications, which is much better than Cauchy M-estimation, MCC, and GNC-GM; (ii) AMCC achieves excellent performance in clustered outliers, whose success rate is 60% $\sim$ 70% percentage points higher than the second-ranked method at 80% of outliers; (iii) AMCC can run in real-time, which is 10 $\sim$ 100 times faster than RANSAC-type methods in low-dimensional estimation problems with high outlier ratios. This gap will increase exponentially with the model dimension. Our source code is available at https://github.com/LJY-WHU/AMCC .

Asymmetric kernel-based robust classification by ADMM

A Robust Classification Framework with Mixture Correntropy

Multi-Kernel Correntropy for Robust Learning

Asymmetric Correntropy for Robust Adaptive Filtering

Generalized Correntropy for Robust Adaptive Filtering.

A Novel Kernel-Based Maximum a Posteriori Classification Method

Mixture Correntropy-Based Robust Distance Metric Learning for Classification

Robust Regression Framework with Asymmetrically Analogous to Correntropy-Induced Loss

Differentially Private Robust ADMM for Distributed Machine Learning.

Robust Regularized Kernel Regression.

Kernel Adaptive Filtering Under Generalized Maximum Correntropy Criterion

Kernel Adaptive Filtering with Maximum Correntropy Criterion

Robust Kernel (Cross-) Covariance Operators in Reproducing Kernel Hilbert Space toward Kernel Methods

Robust Regression With Asymmetric Loss Functions

Kernel Risk-Sensitive Loss: Definition, Properties and Application to Robust Adaptive Filtering

Augmented Maximum Correntropy Criterion for Robust Geometric Perception

Robust Kernel Approximation For Classification

Correntropy-based Metric for Robust Twin Support Vector Machine

Robust PCA Using Generalized Nonconvex Regularization.

A Kernel-Width Adaption Diffusion Maximum Correntropy Algorithm

A Convergent ADMM Framework for Efficient Neural Network Training