Abstract:Renyi's entropy, as a crucial similarity measure of information quantity, is the cornerstone of the minimum error entropy (MEE) criterion. However, the conventional MEE cost had to employ a computationally feasible estimator to approximate the error entropy directly from the data samples, which could be contaminated by large interference outliers, and the performance of MEE could deteriorate in the presence of complex non-Gaussian noises. To address this problem, utilizing the robust statistical properties of M-estimation, the M-estimators are introduced to the MEE criterion by down-weighting or discarding large error residuals; we can then proceed to obtain a more accurate Renyi's-entropy estimator compared to the empirical form under the recalculated error distribution. This innovative approach could be simply implemented while ensuring great robustness. Therefore, a robust adaption criterion called the M-estimation-based minimum error entropy (MMEE), and its corresponding adaptive filtering algorithm are proposed that detect and bound the influence of outliers in non-Gaussian noise. In addition, the mean stability and steady-state performance of the proposed MMEE are evaluated, furthermore, we theoretically prove that the MMEE algorithm could achieve lower steady-state error than MEE under the same conditions. Simulation results verify our theoretical predictions, and demonstrate the superiority and robustness of the MMEE algorithm compared with several existing robust filtering algorithms for restraining various non-Gaussian noises.

Minimum Total Error Entropy Method for Parameter Estimation

A Method of ARX Model Estimation of Errors-in-Variables Systems

Understanding the Method of Interval Errors from the Information Theory Perspective

Model Order Selection In Errors-In-Variables System Identification

Arx Model Estimation Of Multivariable Errors-In-Variables Systems

On Optimal Estimations with Minimum Error Entropy Criterion

Convex Regularized Recursive Minimum Error Entropy Algorithm

Fixed-Point Minimum Error Entropy With Fiducial Points

Maximum total generalized correntropy adaptive filtering for parameter estimation

Improved Minimum Entropy Filtering for Continuous Nonlinear Non-Gaussian Systems Using a Generalized Density Evolution Equation

Minimum Error Entropy Rauch-Tung-Striebel Smoother

Generalized Minimum Error Entropy for Adaptive Filtering

Robust Adaptive Filtering based on M-estimation-based Minimum Error Entropy Criterion

Nonlinear Recursive Minimum Model Error Estimation

Restricted Minimum Error Entropy Criterion for Robust Classification

Consistency analysis of an empirical minimum error entropy algorithm

Adaptive Unscented Kalman Filter under Minimum Error Entropy with Fiducial Points for Non-Gaussian Systems

A New Interpretation on the MMSE As a Robust MEE Criterion

Adaptive filtering by minimizing error's entropy power

Δ-Entropy: Definition, Properties and Applications in System Identification with Quantized Data

Broad learning system based on the quantized minimum error entropy criterion